-- Logs begin at Tue 2022-03-08 18:05:46 UTC, end at Tue 2022-03-08 19:43:59 UTC. -- Mar 08 19:04:05.906713 dv-cinder-830091-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 19:04:05.916881 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 19:04:05 2022] *** Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: nodename: dv-cinder-830091-3-iscsi Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: machine: x86_64 Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: clock source: unix Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: pcre jit disabled Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: detected number of CPU cores: 4 Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: current working directory: / Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: detected binary path: /usr/bin/uwsgi-core Mar 08 19:04:05.918957 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: your processes number limit is 47680 Mar 08 19:04:05.919615 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: your memory page size is 4096 bytes Mar 08 19:04:05.919615 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: detected max file descriptor number: 2048 Mar 08 19:04:05.919615 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: lock engine: pthread robust mutexes Mar 08 19:04:05.919615 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: thunder lock: enabled Mar 08 19:04:05.919615 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 19:04:05.919615 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 19:04:05.964288 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: Python main interpreter initialized at 0x55a3e4b9d9c0 Mar 08 19:04:05.964288 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: python threads support enabled Mar 08 19:04:05.964288 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: your server socket listen backlog is limited to 100 connections Mar 08 19:04:05.964288 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: your mercy for graceful operations on workers is 90 seconds Mar 08 19:04:05.964679 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 19:04:05.964679 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: *** Operational MODE: preforking *** Mar 08 19:04:05.964977 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: *** uWSGI is running in multiple interpreter mode *** Mar 08 19:04:05.964977 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: spawned uWSGI master process (pid: 102904) Mar 08 19:04:05.965169 dv-cinder-830091-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 19:04:05.969742 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: spawned uWSGI worker 1 (pid: 102905, cores: 1) Mar 08 19:04:05.969742 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: spawned uWSGI worker 2 (pid: 102906, cores: 1) Mar 08 19:04:05.969742 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 19:04:07.814328 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:04:07.814328 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: from cryptography.utils import int_from_bytes Mar 08 19:04:07.815001 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:04:07.815001 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: from cryptography.utils import int_from_bytes Mar 08 19:04:07.826497 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:04:07.826497 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: from cryptography.utils import int_from_bytes Mar 08 19:04:07.827003 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:04:07.827003 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: from cryptography.utils import int_from_bytes Mar 08 19:04:10.402806 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 19:04:10.403857 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 19:04:10.403857 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 19:04:10.404159 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 19:04:10.404516 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 19:04:10.404609 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 19:04:10.404692 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 19:04:10.404845 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 19:04:10.405982 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.405982 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.406156 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 19:04:10.406156 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 19:04:10.407716 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.407716 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.407894 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.408001 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.408097 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.408185 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.408265 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.408353 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.409447 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.409539 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.409632 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.409726 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.409816 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.409897 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.409976 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410055 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410133 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410218 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830091-3-iscsi {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410306 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410386 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410464 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410552 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410641 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410729 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410809 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830091-3-iscsi {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.410894 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.411276 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.411415 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.411532 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.411651 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.411758 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.411863 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412011 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412011 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412241 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412389 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412518 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412601 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412756 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412848 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.412948 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413029 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413108 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413196 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413276 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413361 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413441 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413574 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413665 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413751 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413840 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.413952 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.414034 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.414112 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.414237 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.414326 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.414458 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830091-3-iscsi {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.414563 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.414782 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.414873 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.415100 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.415236 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830091-3-iscsi {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.415420 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.415553 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.415843 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.416003 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.416186 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.416275 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.416688 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.416805 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.416902 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.417168 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.417274 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.417504 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.417710 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.417845 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.417968 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.418155 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.418307 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.418629 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.418770 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.418954 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.419089 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.419277 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.419412 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.419586 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.419723 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.419888 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.420042 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.420223 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.420379 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.420535 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.420679 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.420851 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.420985 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.421154 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.421288 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.421426 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.421551 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.421701 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.421827 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.422010 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.422146 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.422337 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.422475 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.422660 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.422789 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.422924 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.423049 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.423188 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.423325 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.423458 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.423583 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.423766 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.423905 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.424104 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.424246 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.424412 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.424545 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.424723 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.424852 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.425029 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.425164 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.425336 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.425473 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.425644 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.425775 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.425949 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.426078 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.426254 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.426383 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.426561 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.426692 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.426880 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.427007 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.427193 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.427319 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.427503 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.427631 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.427810 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.427959 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.428155 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.428295 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.428493 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.428627 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.428792 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.428928 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.429102 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.429245 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.429442 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.429579 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.429756 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.429881 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.430082 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.430229 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.430409 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.430548 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.430722 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.430850 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.431034 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.431180 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.431346 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.431475 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.431671 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.431800 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.432034 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.432166 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.432344 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.432507 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.432644 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.432870 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.433015 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.433142 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.433267 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.433937 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.434065 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.434350 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.434488 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.434674 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.434802 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.434984 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.435112 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.435299 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.435436 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.435605 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.435733 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.435905 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.436062 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.436244 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.436381 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.436550 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.436721 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.436857 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.436982 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.437149 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.437278 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.437456 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.437583 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.437761 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.437887 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.438068 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.438196 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.438374 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.438501 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.438680 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.438808 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.438998 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.439126 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.439307 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.439434 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.439612 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.439736 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.439953 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.440084 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.440246 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.440390 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.440552 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.440695 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.440860 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.440988 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.441168 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.441294 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.441472 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.441601 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.441781 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.441909 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.442086 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.442211 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.442390 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.442519 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.442701 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.442828 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.443006 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.443133 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.443308 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.443436 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.443617 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.443745 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.443927 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.444056 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.444241 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.444379 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.444560 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.444695 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.444867 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.445001 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.445174 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.445374 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.445508 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.445633 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.445779 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.445906 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.446087 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.446223 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.446396 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.446532 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.446702 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.446830 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.447025 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.447162 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.447333 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.447466 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.447651 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.447777 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.447988 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.448120 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.448299 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.448424 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.448605 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.448734 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.448925 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.449634 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.449866 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:04:10.450040 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.450209 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.450391 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.450551 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.450713 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.450898 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.451055 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.451215 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.451395 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.451552 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.451720 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.451889 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.452064 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.452236 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.452376 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.452552 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.452701 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.452869 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.453019 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.453197 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.453340 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.453508 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.453637 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.453823 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.453975 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.454196 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.454332 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.454571 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.454696 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.454891 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.455039 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.455261 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.455394 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.455587 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.455723 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.455905 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.456090 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.456251 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.456433 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.456570 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.456807 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.456943 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.457186 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.457316 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.457535 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.457662 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.457883 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.458012 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.458201 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.458347 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.458531 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.458671 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.458854 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.459017 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.459171 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.459386 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.459517 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.459722 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.459851 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.460074 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.460215 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.460394 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.460524 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.460711 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.460839 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.461027 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.461164 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.461354 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.461484 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.461670 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.461797 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.461984 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.462122 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.462299 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.462428 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.462611 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.462745 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.462926 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.463068 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.463240 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.463368 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.463554 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.463682 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.463866 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.464027 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.464212 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.464341 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.464530 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.464688 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.464887 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.465072 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.465203 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.465396 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.465518 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.465706 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.465843 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.466015 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.466144 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.466324 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.466452 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.466640 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.466783 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.466948 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.467087 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.467272 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.467401 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.467579 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.467719 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.467885 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.468077 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.468234 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.468363 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.468546 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.468682 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.468857 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.468993 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.469170 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.469303 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.469507 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.469633 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.469785 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.469983 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.470112 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.470336 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.470474 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.470686 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.470813 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.470998 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.471136 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.471308 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.471447 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.471613 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.471741 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.471938 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.472067 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.472263 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.472400 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.472569 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.472697 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.472875 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.473004 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.473181 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.473316 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.473485 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.473620 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.473797 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.473930 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.474106 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.474234 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.474417 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.474546 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.474727 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.474858 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.475038 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.475168 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.475353 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.475480 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.475666 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.475793 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.476003 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.476146 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.476344 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.476472 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.476673 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.476809 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.476978 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.477112 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.477306 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.477435 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.477611 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.477751 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.477926 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.478062 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.478229 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.478364 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.478536 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.478672 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.478840 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.478973 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.479146 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.479276 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.479448 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.479584 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.479756 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.479882 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.480083 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.480236 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.480416 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.480551 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.480725 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.480917 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.481070 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.481204 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.481340 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.481474 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.481645 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.481773 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.481951 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.482080 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.482257 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.482387 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.482600 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.482728 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.482908 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.483035 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.483252 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.483381 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.483560 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.483688 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.483897 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.484065 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.484247 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.484384 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.484612 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.484754 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.484880 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.485018 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.485189 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.485318 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.485506 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.485634 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.485822 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.485959 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.486133 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.486263 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.486445 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.486573 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.486756 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.486895 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.487076 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.487212 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.487388 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.487640 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.487770 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.488038 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.488180 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.488362 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.488489 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.488673 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.488810 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.488989 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.489117 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.489293 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.489420 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.489612 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.489797 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.489953 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.490140 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.490289 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.490462 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.490592 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.490793 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.490930 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.491111 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.491239 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.491432 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.491560 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.491748 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.491879 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.492089 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.492218 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.492405 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.492551 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.492720 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.492849 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.493035 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.493168 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.493349 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.493486 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.493668 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.493796 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.493980 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.494107 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.494304 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.494439 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.494614 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.494742 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.494934 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.495063 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.495243 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.495383 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.495557 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.495683 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.496415 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.496568 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.496750 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.496893 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.497049 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.497179 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.497360 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.497497 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.497679 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.497819 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.497990 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.498118 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.498300 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.498474 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.498753 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.498895 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.499046 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.499236 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.499365 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.499489 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.499700 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.499828 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.499999 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.500231 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.500361 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.500477 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.500610 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.500743 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.500868 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.500992 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.501116 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.501279 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.501410 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.501594 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.501724 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.501904 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.502041 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.502215 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.502353 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.502531 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.502662 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.502846 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.502973 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.503162 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.503289 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.503489 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.503627 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.503816 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.503969 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.504151 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.504282 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.504463 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.504599 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.504772 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.504912 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.505077 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.505213 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.505383 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.505513 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.505690 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.505826 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.505996 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.506133 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.506332 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.506459 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.506639 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.506778 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.506945 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.507072 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.507265 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.507392 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.507577 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.507752 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.507888 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.508078 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.508212 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.508346 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.508512 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.508644 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.508824 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.508950 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.509134 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.509261 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.509443 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.509572 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.509752 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.509879 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.510061 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.510194 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.510367 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.510495 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.510675 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.510807 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.511000 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.511129 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.511309 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.511487 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.512197 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.512337 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.512513 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.512651 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.512829 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.512959 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.513135 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.513271 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.513448 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.513586 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.513769 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.514070 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.514340 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.514469 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.514674 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.514816 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.514993 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.515121 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.515317 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.515453 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.515634 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.515770 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.515972 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.516104 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.516311 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.516439 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.516642 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.516793 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.516986 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.517128 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.517262 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.517388 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.517525 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.517659 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.517822 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.517960 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.518134 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.518262 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.518439 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.518566 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.518743 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.518880 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.519048 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.519184 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.519353 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.519479 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.519653 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.519774 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.519976 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.520107 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.520284 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.520412 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.520588 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.520718 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.520893 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.521019 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.521194 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.521320 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.521502 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.521637 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.521801 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.521928 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.522106 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.522233 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.522420 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.522548 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.522724 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.522851 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.523028 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.523164 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.523328 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.523454 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.523632 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.523758 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.523976 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.524156 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.524310 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.524437 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.524637 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.524770 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.524973 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.525109 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.525278 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.525413 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.525583 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.525711 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.525913 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.526054 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.526218 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.526346 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.526521 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.526648 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.526822 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.526951 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.527199 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.527334 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.527514 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.527643 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.527825 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.527997 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.528407 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.528537 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.528722 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.528849 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.529033 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.529163 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.529346 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.529473 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.529658 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.529785 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.529963 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.530092 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.530263 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.530388 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.530567 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.530708 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.530875 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.531009 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.531178 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.531307 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.531482 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.531623 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.531784 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.531911 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.532123 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.532251 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.532423 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.532564 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.532726 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.532854 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.533024 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.533158 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.533328 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.533464 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.533628 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.533748 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.533931 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.534059 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.534232 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.534361 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.534536 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.534661 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.534841 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.534975 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.535142 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.535278 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.535451 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.535578 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.535765 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.535893 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.536084 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.536212 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.536386 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.536521 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.536689 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.536849 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.536996 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.537121 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.537275 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.537404 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.537583 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.537721 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.537893 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.538028 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.538206 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.538332 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.538510 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.538652 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.538813 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.538940 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.539114 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.539241 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.539417 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.539556 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.539725 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.539855 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.540057 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.540188 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.540369 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.540507 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.540674 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.540811 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.540980 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.541117 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.541285 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.541414 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.541590 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.541718 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.541893 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.542032 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.542212 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.542341 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.542516 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.542644 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.542843 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.543011 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.543149 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.543277 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.543442 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.543578 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.543785 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.543953 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.544116 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.544256 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.544479 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.544608 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.544787 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.544924 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.545106 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.545233 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.545418 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.545545 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.545731 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.545866 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.546042 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.546169 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.546346 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.546475 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.546649 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.546789 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.546967 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.547096 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.547279 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.547409 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.547593 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.547728 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.547898 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.548058 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.548229 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.548358 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.548554 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.548692 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.548861 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.548997 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.549172 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.549299 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.549495 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.549623 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.549820 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.549949 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.550124 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.550252 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.550432 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.550562 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.550742 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.550877 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.551050 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.551191 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.551357 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.551485 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.551665 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.551791 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.551997 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.552128 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.552309 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.552437 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.552617 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.552745 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.552927 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.553070 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.553237 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.553373 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.553540 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.553669 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.553845 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.553982 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.554151 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.554278 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.554454 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.554589 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.554760 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.554897 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.555078 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.555213 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.555384 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.555511 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.555694 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.555834 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.556022 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.556162 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.556330 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.556457 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.556631 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.556759 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.556935 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.557056 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.557365 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.557493 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.557710 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.557838 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.557965 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.558090 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.558268 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.558902 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.559090 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.559278 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.559414 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.559604 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.559742 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.559966 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.560113 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.560260 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.560390 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.560661 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.560792 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.560975 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.561099 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.561287 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.561427 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.561597 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.561726 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.561903 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.562033 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.562209 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.562338 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.562520 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.562649 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.562846 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.562976 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.563152 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.563281 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.563459 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.563588 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.563764 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.563894 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.564117 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.564246 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.564421 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.564562 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.564743 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.564876 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.565160 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.565293 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.565473 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.565616 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.565778 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.565907 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.566196 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.566333 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.566508 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.566645 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.566819 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.566949 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.567143 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.567278 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.567467 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.567595 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.567791 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.567944 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.568124 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.568252 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.568438 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.568794 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.569023 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.569205 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.569336 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.569479 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.569613 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.569740 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.569874 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.570001 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.570127 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.570252 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.570376 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.570503 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.570636 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.570764 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.570891 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.571017 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.571189 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.571319 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.571514 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.571659 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.571942 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.572087 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.572265 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.572402 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.572574 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.572712 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.572897 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.573028 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.573223 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.573363 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.573532 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.573672 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.573836 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.574006 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.574744 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.574889 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.575101 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.575229 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.575420 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.575549 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.575750 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.575889 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.576085 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.576216 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.576403 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.576539 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.576721 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.576853 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.577035 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.577165 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.577345 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.577475 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.577649 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.577785 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.577974 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.578103 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.578278 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.578406 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.578603 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.578732 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.578916 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.579044 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.579240 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.579370 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.579563 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.579699 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.579868 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.580035 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.580220 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.580363 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.580530 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.580659 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.580836 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.580974 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.581139 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.581276 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.581444 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.581572 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.581787 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.581915 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.582094 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.582231 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.582414 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.582550 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.582746 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.582882 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.583080 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.583220 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.583394 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.583524 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.583731 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.583861 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.584084 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.584234 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.584406 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.584545 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.584750 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.584914 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.585055 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.585183 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.585345 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.585474 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.585650 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.585786 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.585961 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.586090 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.586265 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.586394 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.586571 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.586700 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.586878 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.587022 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.587186 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.587315 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.587489 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.587625 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.587790 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.587971 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.588114 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.588260 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.588433 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.588577 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.588739 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.588869 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.589064 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.589194 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.589375 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.589518 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.589730 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.589944 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.590129 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.590366 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.590494 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.590638 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.590775 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.590903 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.591029 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.591154 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.591287 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.591405 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.591576 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.591707 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.591900 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.592055 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.592252 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.592393 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.592565 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.592693 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.592890 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.593024 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.593208 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.593346 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.593523 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.593654 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.593840 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.593968 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.594153 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.594282 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.594470 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.594598 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.594784 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.594920 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.595101 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.595232 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.595413 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.595543 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.595729 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.595867 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.596072 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.596201 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.596395 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.596541 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.596915 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.597054 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.597245 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.597374 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.597557 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.597725 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.597856 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.598057 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.598183 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.598314 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.598470 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.598600 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.598782 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.598913 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.599092 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.599222 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.599404 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.599532 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.599713 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.599843 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.600074 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.600218 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.600374 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.600500 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.600685 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.600824 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.601013 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.601148 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.601348 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.601492 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.601665 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.601793 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.601979 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.602108 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.602296 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.602435 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.602611 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.602741 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.602969 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.603112 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.603281 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.603419 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.603588 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.603716 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.603898 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.604062 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.604236 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.604360 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.604549 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.604679 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.604860 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.604996 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.605190 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.605375 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.605619 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.605795 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.605966 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.606103 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.606103 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.606344 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.606469 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.606593 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.606729 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.606864 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.607013 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.607150 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.607336 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.607477 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.607666 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.607804 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.608008 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.608138 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.608321 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.608461 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.608638 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.608769 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.608954 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.609081 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.609467 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.609611 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.609780 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.609911 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.610114 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.610242 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.610437 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.610577 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.610761 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.610893 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.611078 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.611205 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.611391 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.611521 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.611719 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.611847 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.612049 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.612189 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.612356 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.612494 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.612666 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.612794 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.612976 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.613104 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.613279 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.613417 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.613602 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.613732 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.613914 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.614041 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.614216 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.614353 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.614535 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.614664 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.614843 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.614971 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.615373 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.615512 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.615723 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.615851 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.616067 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.616199 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.616398 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.616530 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.616725 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.616855 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.617043 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.617176 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.617345 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.617476 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.617671 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.617809 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.617978 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.618115 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.618287 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.618409 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.618600 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.618729 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.618911 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.619049 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.619218 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.619348 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.619523 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.619653 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.619836 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.620012 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.620173 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.620312 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.620480 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.620611 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.621290 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.621441 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.621610 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.621738 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.621940 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.622077 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.622247 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.622386 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.622553 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.622683 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.622860 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.622991 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.623171 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.623309 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.623476 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.623614 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.623781 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.623911 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.624107 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.624244 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.624409 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.624539 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.624722 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.624857 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.625024 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.625153 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.625333 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.625464 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.625636 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.625766 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.625946 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.626077 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.626253 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.626382 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.626571 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.626701 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.626923 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.627053 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.627252 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.627383 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.627561 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.627765 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.627894 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.628043 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.628201 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.628343 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.628518 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.628657 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.628846 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.628978 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.629163 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.629376 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.629514 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.629695 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.629827 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.630044 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.630174 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.630367 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.630641 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.630902 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.631035 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.631240 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.631371 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.631564 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.631704 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.631898 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.632091 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.632256 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.632395 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.632565 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.632704 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.632873 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.633015 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.633176 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.633304 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.633500 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.633649 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.633813 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.633954 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.634124 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.634252 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.634431 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.634561 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.634743 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.634872 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.635051 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.635202 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.635344 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.635472 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.635657 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.635799 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.635992 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.636123 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.636303 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.636470 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.637212 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.637345 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.637527 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.637667 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.637827 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.637956 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.638144 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.638277 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.638489 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.638621 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.638810 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.638948 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.639126 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.639256 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.639447 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.639591 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.639763 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.639894 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.640102 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.640232 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.640418 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.640560 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.640732 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.640870 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.641043 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.641172 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.641360 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.641491 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.641685 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.641896 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.642026 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.642213 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.642411 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.642763 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.642909 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.643042 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.643211 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.643356 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.643486 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.643613 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.643740 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.643954 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.644087 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.644304 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.644463 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.644620 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.644791 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.644946 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.645117 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.645257 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.645429 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.645589 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.645750 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.645935 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.646074 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.646272 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.646402 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.646606 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.646742 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.646917 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.647229 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.647344 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.647537 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.647661 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.647852 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.647982 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.648197 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.648314 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.648511 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.648631 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.648885 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.649059 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.649384 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.649521 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.649696 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.649952 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.650082 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.650272 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.650403 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.650587 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.650714 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.650892 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.651020 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.651202 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.651331 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.651519 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.651648 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.651829 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.651993 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.652287 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.652516 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.652717 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.652935 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.653085 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.653449 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.653567 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.653675 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.653883 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.654006 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.654201 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.654511 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.654650 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.654820 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.654950 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.655134 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.655262 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.655443 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.655604 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.655733 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.655987 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.656124 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.656348 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.656489 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.656656 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.656787 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.656961 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.657101 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.657301 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.657444 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.657639 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.657778 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.657958 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.658086 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.658283 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.658412 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.658594 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.658722 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.658944 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.659079 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.659280 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.659407 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.659540 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.659668 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.659843 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.660035 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.660173 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.660298 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.660484 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.660613 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.660800 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.660929 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.661114 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.661244 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.661421 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.661548 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.661733 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.661872 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.662046 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.662176 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.662358 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.662489 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.662669 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.662809 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.662993 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.663129 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.663319 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.663447 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.663624 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.663762 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.667761 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.667878 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.667878 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668031 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668116 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668187 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668254 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668329 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668398 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668464 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668464 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668598 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668666 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668732 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668732 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668863 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.668938 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669100 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669180 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669255 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669349 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669446 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669527 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669605 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669690 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669770 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669770 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669920 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.669999 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670087 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670174 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670253 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670337 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670429 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670509 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670586 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670664 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670741 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670818 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670904 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.670984 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 19:04:10.671070 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.671070 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.671070 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.671347 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:04:10.671592 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102906) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 19:04:10.693618 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_db.sqlalchemy.engines [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:04:10.694637 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG oslo_db.sqlalchemy.engines [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:04:10.757753 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.context [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54c5021f-2f67-450e-b2bf-a7af4b069dbb(cell1) {{(pid=102905) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 19:04:10.758712 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.context [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54c5021f-2f67-450e-b2bf-a7af4b069dbb(cell1) {{(pid=102906) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 19:04:10.762589 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:04:10.763553 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG oslo_concurrency.lockutils [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:04:10.764227 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:04:10.765027 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:04:10.765208 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG oslo_concurrency.lockutils [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:04:10.766024 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG oslo_concurrency.lockutils [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:04:10.766946 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:04:10.767973 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG oslo_concurrency.lockutils [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102906) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:04:10.779807 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_db.sqlalchemy.engines [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:04:10.780862 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG oslo_db.sqlalchemy.engines [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:04:10.783758 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG oslo_db.sqlalchemy.engines [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:04:10.926047 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_db.sqlalchemy.engines [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:04:10.948077 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_db.sqlalchemy.engines [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:04:10.950591 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG oslo_db.sqlalchemy.engines [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102906) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:04:11.400277 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: WARNING keystonemiddleware.auth_token [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:04:11.402038 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: WARNING keystonemiddleware.auth_token [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:04:11.407479 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: WARNING keystonemiddleware.auth_token [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:04:11.409011 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: WARNING keystonemiddleware.auth_token [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:04:11.759938 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: WARNING keystonemiddleware.auth_token [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:04:11.765493 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: WARNING keystonemiddleware.auth_token [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:04:11.770623 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3e4b9d9c0 pid: 102906 (default app) Mar 08 19:04:11.772713 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:04:11.773875 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] 10.222.0.75 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001754 Mar 08 19:04:11.774291 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 1/1] 10.222.0.75 () {50 vars in 788 bytes} [Tue Mar 8 19:04:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:04:11.797720 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: WARNING keystonemiddleware.auth_token [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:04:11.803063 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: WARNING keystonemiddleware.auth_token [None req-b21e905a-d798-42b6-959b-e64366daaee0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:04:11.809063 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a3e4b9d9c0 pid: 102905 (default app) Mar 08 19:05:37.472575 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:37.473710 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 Mar 08 19:05:37.474438 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 2/2] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:05:37.918311 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-e2857750-7959-448e-81e2-c88cb89d2125 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:37.949458 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-e2857750-7959-448e-81e2-c88cb89d2125 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.467603 Mar 08 19:05:37.950519 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1291 bytes} [Tue Mar 8 19:05:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:05:40.318578 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:40.319582 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-8bff13ad-14af-440d-ae3f-b3e307b23116 None None] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Mar 08 19:05:40.320289 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 3/4] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:05:40.385256 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-a7c61768-da71-49ba-8191-5b03b9404a31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "swap": 0, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:40.404319 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:05:40.404319 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: warnings.warn(msg) Mar 08 19:05:40.494205 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-a7c61768-da71-49ba-8191-5b03b9404a31 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.167488 Mar 08 19:05:40.494697 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 2/5] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:05:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:05:40.713410 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-af480d1b-6cbd-49e2-8639-6bde815a0997 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:40.715821 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:05:40.715821 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: warnings.warn(msg) Mar 08 19:05:40.834050 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-af480d1b-6cbd-49e2-8639-6bde815a0997 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331535 Mar 08 19:05:40.835235 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 4/6] 10.222.0.75 () {64 vars in 1335 bytes} [Tue Mar 8 19:05:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:05:43.207518 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-a7c61768-da71-49ba-8191-5b03b9404a31 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:43.208590 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-a7c61768-da71-49ba-8191-5b03b9404a31 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Mar 08 19:05:43.208994 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 3/7] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:05:43.335752 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-1549b323-0d8f-47fc-b9b1-b5578bd5cf27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M", "swap": 0, "disk": 5, "ram": 512, "id": "d1", "vcpus": 1}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:43.356702 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:05:43.356702 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: warnings.warn(msg) Mar 08 19:05:43.473869 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-1549b323-0d8f-47fc-b9b1-b5578bd5cf27 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.257802 Mar 08 19:05:43.474669 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 5/8] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:05:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:05:43.487640 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-3a3d3ced-3218-4eaf-b030-6aab78f58e34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:43.489308 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:05:43.489308 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: warnings.warn(msg) Mar 08 19:05:43.603383 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-3a3d3ced-3218-4eaf-b030-6aab78f58e34 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119044 Mar 08 19:05:43.607932 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 4/9] 10.222.0.75 () {64 vars in 1335 bytes} [Tue Mar 8 19:05:43 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:05:45.975102 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-1549b323-0d8f-47fc-b9b1-b5578bd5cf27 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:45.976250 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-1549b323-0d8f-47fc-b9b1-b5578bd5cf27 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Mar 08 19:05:45.976717 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 6/10] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:05:46.045659 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-dd7cda40-aa67-430d-97e3-72332b8604fb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "swap": 0, "id": "d2", "rxtx_factor": 1.0}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:46.135722 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-dd7cda40-aa67-430d-97e3-72332b8604fb admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.152056 Mar 08 19:05:46.136305 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 5/11] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:05:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:05:46.148856 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-3ae48a89-fec8-4157-870f-ebee5fa46654 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:46.235306 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-3ae48a89-fec8-4157-870f-ebee5fa46654 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090737 Mar 08 19:05:46.237306 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 7/12] 10.222.0.75 () {64 vars in 1335 bytes} [Tue Mar 8 19:05:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:05:48.685289 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-dd7cda40-aa67-430d-97e3-72332b8604fb admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:48.686521 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-dd7cda40-aa67-430d-97e3-72332b8604fb admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Mar 08 19:05:48.686759 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 6/13] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:05:48.756403 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-db4403c0-ace4-43d9-ac1c-a7ad9db2074b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "swap": 0}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:48.835275 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-db4403c0-ace4-43d9-ac1c-a7ad9db2074b admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.142082 Mar 08 19:05:48.835883 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 8/14] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:05:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:05:48.857093 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-59bde933-81ae-40b9-81d2-c843deb91664 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:48.963755 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-59bde933-81ae-40b9-81d2-c843deb91664 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117409 Mar 08 19:05:48.964725 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 7/15] 10.222.0.75 () {64 vars in 1335 bytes} [Tue Mar 8 19:05:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:05:51.451041 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-db4403c0-ace4-43d9-ac1c-a7ad9db2074b admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:51.452388 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-db4403c0-ace4-43d9-ac1c-a7ad9db2074b admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001807 Mar 08 19:05:51.453069 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 9/16] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:05:51.517552 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-5f5c3f5f-32a5-45f0-a101-eeac4baceea0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:51.622250 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-5f5c3f5f-32a5-45f0-a101-eeac4baceea0 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163214 Mar 08 19:05:51.622817 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 8/17] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:05:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:05:51.644582 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-d5a81792-53af-4f43-8ffd-31135f439d24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:51.734141 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-d5a81792-53af-4f43-8ffd-31135f439d24 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101827 Mar 08 19:05:51.734728 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 10/18] 10.222.0.75 () {64 vars in 1335 bytes} [Tue Mar 8 19:05:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:05:54.182148 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-5f5c3f5f-32a5-45f0-a101-eeac4baceea0 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:54.183171 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-5f5c3f5f-32a5-45f0-a101-eeac4baceea0 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Mar 08 19:05:54.183807 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 9/19] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:05:54.244497 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-8e3cba46-7c64-42cd-a98d-bdfb16241428 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:54.268463 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-8e3cba46-7c64-42cd-a98d-bdfb16241428 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.078740 Mar 08 19:05:54.269015 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 11/20] 10.222.0.75 () {60 vars in 1291 bytes} [Tue Mar 8 19:05:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:05:57.047324 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-5f5c3f5f-32a5-45f0-a101-eeac4baceea0 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:57.048836 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-5f5c3f5f-32a5-45f0-a101-eeac4baceea0 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Mar 08 19:05:57.049446 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 10/21] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:05:57.114020 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-ddee05dd-eb33-449a-9fc8-c626a96d378d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1, "disk": 1, "id": "1"}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:57.193183 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-ddee05dd-eb33-449a-9fc8-c626a96d378d admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.136100 Mar 08 19:05:57.193602 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 12/22] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:05:57 2022] POST /compute/v2.1/flavors => generated 402 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:05:57.208334 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-90ad850f-b2e1-4ac8-a956-590fee4c0be6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:57.318587 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-90ad850f-b2e1-4ac8-a956-590fee4c0be6 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115287 Mar 08 19:05:57.319442 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 11/23] 10.222.0.75 () {64 vars in 1332 bytes} [Tue Mar 8 19:05:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:05:59.785478 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-ddee05dd-eb33-449a-9fc8-c626a96d378d admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:05:59.786514 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-ddee05dd-eb33-449a-9fc8-c626a96d378d admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Mar 08 19:05:59.786946 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 13/24] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:05:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:05:59.855729 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-fa6cfd07-c38d-4acc-b591-2ea29157bede admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "id": "2", "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:05:59.928005 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-fa6cfd07-c38d-4acc-b591-2ea29157bede admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133293 Mar 08 19:05:59.929024 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 12/25] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:05:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:05:59.943725 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-b5cf21c6-62b1-49c0-aed9-d96a763e3fed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:00.028344 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-b5cf21c6-62b1-49c0-aed9-d96a763e3fed admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089764 Mar 08 19:06:00.029343 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 14/26] 10.222.0.75 () {64 vars in 1332 bytes} [Tue Mar 8 19:05:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:06:02.465902 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-fa6cfd07-c38d-4acc-b591-2ea29157bede admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:02.466932 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-fa6cfd07-c38d-4acc-b591-2ea29157bede admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Mar 08 19:06:02.467347 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 13/27] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:06:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:02.534413 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-448f6fea-9482-4580-baa3-ed2b803c774f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:02.638519 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-448f6fea-9482-4580-baa3-ed2b803c774f admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.163431 Mar 08 19:06:02.639228 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 15/28] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:06:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:06:02.652391 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-1a5395e6-5539-445b-b164-b52627f463ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:02.738646 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-1a5395e6-5539-445b-b164-b52627f463ac admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091252 Mar 08 19:06:02.739252 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 14/29] 10.222.0.75 () {64 vars in 1332 bytes} [Tue Mar 8 19:06:02 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:06:05.231184 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-448f6fea-9482-4580-baa3-ed2b803c774f admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:05.232327 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-448f6fea-9482-4580-baa3-ed2b803c774f admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001610 Mar 08 19:06:05.232762 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 16/30] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:06:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:05.295459 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-16133b7b-f0e1-47c2-8562-21fe1e3c9279 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "ram": 8192}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:05.689314 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-16133b7b-f0e1-47c2-8562-21fe1e3c9279 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450076 Mar 08 19:06:05.689868 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 15/31] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:06:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:06:05.702727 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-a7ce374f-f390-447e-919e-e342978e5ee2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:05.774154 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-a7ce374f-f390-447e-919e-e342978e5ee2 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074638 Mar 08 19:06:05.778512 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 17/32] 10.222.0.75 () {64 vars in 1332 bytes} [Tue Mar 8 19:06:05 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:06:08.238128 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-16133b7b-f0e1-47c2-8562-21fe1e3c9279 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:08.239277 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-16133b7b-f0e1-47c2-8562-21fe1e3c9279 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Mar 08 19:06:08.244081 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 16/33] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:06:08 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:08.302908 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-736318fc-587d-40f1-bb0d-8a9874293164 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 8, "id": "5"}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:08.497014 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-736318fc-587d-40f1-bb0d-8a9874293164 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.250540 Mar 08 19:06:08.498257 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 18/34] 10.222.0.75 () {64 vars in 1282 bytes} [Tue Mar 8 19:06:08 2022] POST /compute/v2.1/flavors => generated 408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:06:08.510151 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-b3def303-4bc8-46d7-bc27-a37728565d82 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:08.624857 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-b3def303-4bc8-46d7-bc27-a37728565d82 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118551 Mar 08 19:06:08.625565 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 17/35] 10.222.0.75 () {64 vars in 1332 bytes} [Tue Mar 8 19:06:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:06:32.531125 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-736318fc-587d-40f1-bb0d-8a9874293164 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:32.532179 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-736318fc-587d-40f1-bb0d-8a9874293164 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Mar 08 19:06:32.532576 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 19/36] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:32.588907 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-cd58c59f-d06d-4f33-a54f-fae1267e5243 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:32.605343 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-cd58c59f-d06d-4f33-a54f-fae1267e5243 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067119 Mar 08 19:06:32.605999 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 18/37] 10.222.0.75 () {60 vars in 1291 bytes} [Tue Mar 8 19:06:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:06:33.987219 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-736318fc-587d-40f1-bb0d-8a9874293164 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:33.988250 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-736318fc-587d-40f1-bb0d-8a9874293164 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Mar 08 19:06:33.988642 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 20/38] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:34.226402 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-cb8b6418-05f8-45ed-8b2c-8d629a4e4746 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:34.231964 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.wsgi [None req-cb8b6418-05f8-45ed-8b2c-8d629a4e4746 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 19:06:34.232542 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-cb8b6418-05f8-45ed-8b2c-8d629a4e4746 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:06:34.233386 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-cb8b6418-05f8-45ed-8b2c-8d629a4e4746 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059915 Mar 08 19:06:34.233967 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 19/39] 10.222.0.75 () {60 vars in 1190 bytes} [Tue Mar 8 19:06:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:06:34.243356 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-9a2d3350-d45a-4fbb-905b-993e2ad64b95 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:34.264533 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-9a2d3350-d45a-4fbb-905b-993e2ad64b95 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024746 Mar 08 19:06:34.265065 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 21/40] 10.222.0.75 () {60 vars in 1210 bytes} [Tue Mar 8 19:06:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:06:34.276034 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-af49db64-5e8e-44cc-8c4b-422433aa03a7 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:34.298016 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-af49db64-5e8e-44cc-8c4b-422433aa03a7 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026915 Mar 08 19:06:34.298782 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 20/41] 10.222.0.75 () {60 vars in 1210 bytes} [Tue Mar 8 19:06:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:06:34.308150 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-7e9cfc82-f521-4bfe-afea-4d88c9041fcd admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:34.314236 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.wsgi [None req-7e9cfc82-f521-4bfe-afea-4d88c9041fcd admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 08 19:06:34.314860 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-7e9cfc82-f521-4bfe-afea-4d88c9041fcd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:06:34.317689 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-7e9cfc82-f521-4bfe-afea-4d88c9041fcd admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011151 Mar 08 19:06:34.317689 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 22/42] 10.222.0.75 () {60 vars in 1190 bytes} [Tue Mar 8 19:06:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:06:35.589317 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-af49db64-5e8e-44cc-8c4b-422433aa03a7 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:35.590317 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-af49db64-5e8e-44cc-8c4b-422433aa03a7 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Mar 08 19:06:35.590706 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 21/43] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:06:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:35.792353 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-2edcb50b-458c-43fc-b935-2ec0532602bb admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:35.797709 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.wsgi [None req-2edcb50b-458c-43fc-b935-2ec0532602bb admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 19:06:35.798211 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-2edcb50b-458c-43fc-b935-2ec0532602bb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:06:35.799077 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-2edcb50b-458c-43fc-b935-2ec0532602bb admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059259 Mar 08 19:06:35.799588 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 23/44] 10.222.0.75 () {60 vars in 1190 bytes} [Tue Mar 8 19:06:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:06:35.809073 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-e27149bc-cfcc-4950-a557-252896556c09 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:35.822609 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-e27149bc-cfcc-4950-a557-252896556c09 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017111 Mar 08 19:06:35.823162 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 22/45] 10.222.0.75 () {60 vars in 1210 bytes} [Tue Mar 8 19:06:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:06:35.832426 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-9bda8cb1-2da5-4e80-9267-debc5e907398 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:35.846749 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-9bda8cb1-2da5-4e80-9267-debc5e907398 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017846 Mar 08 19:06:35.847267 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 24/46] 10.222.0.75 () {60 vars in 1210 bytes} [Tue Mar 8 19:06:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:06:35.857237 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-93d18b7e-6d8b-477a-ba06-7a634e1369a0 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:35.862277 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.wsgi [None req-93d18b7e-6d8b-477a-ba06-7a634e1369a0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 08 19:06:35.862829 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-93d18b7e-6d8b-477a-ba06-7a634e1369a0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:06:35.863634 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-93d18b7e-6d8b-477a-ba06-7a634e1369a0 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009943 Mar 08 19:06:35.864154 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 23/47] 10.222.0.75 () {60 vars in 1190 bytes} [Tue Mar 8 19:06:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 08 19:06:37.128508 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-9bda8cb1-2da5-4e80-9267-debc5e907398 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:37.129521 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-9bda8cb1-2da5-4e80-9267-debc5e907398 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Mar 08 19:06:37.129907 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 25/48] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:06:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:06:37.321844 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-ecde346a-bd15-4225-b35c-9eb9c549a7e6 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:37.327340 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.wsgi [None req-ecde346a-bd15-4225-b35c-9eb9c549a7e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 19:06:37.327929 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-ecde346a-bd15-4225-b35c-9eb9c549a7e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:06:37.328782 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-ecde346a-bd15-4225-b35c-9eb9c549a7e6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060918 Mar 08 19:06:37.329308 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 24/49] 10.222.0.75 () {60 vars in 1193 bytes} [Tue Mar 8 19:06:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 08 19:06:37.339265 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-01bddebf-5a00-42a6-af0d-b4d750f2b284 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:37.353856 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-01bddebf-5a00-42a6-af0d-b4d750f2b284 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018214 Mar 08 19:06:37.354634 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1210 bytes} [Tue Mar 8 19:06:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:06:37.366229 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:37.379130 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018446 Mar 08 19:06:37.379717 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 25/51] 10.222.0.75 () {60 vars in 1210 bytes} [Tue Mar 8 19:06:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:06:37.389226 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-e03a183e-07e8-4a45-b58e-6fe74e5f331c admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:37.394353 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.wsgi [None req-e03a183e-07e8-4a45-b58e-6fe74e5f331c admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 08 19:06:37.394937 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-e03a183e-07e8-4a45-b58e-6fe74e5f331c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102906) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:06:37.395707 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-e03a183e-07e8-4a45-b58e-6fe74e5f331c admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010117 Mar 08 19:06:37.396239 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1193 bytes} [Tue Mar 8 19:06:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 08 19:06:38.681458 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:38.682467 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Mar 08 19:06:38.682868 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 26/53] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:06:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:06:38.871647 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-7965e3ed-fccb-4f18-a2c8-d79447448c2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:38.979424 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-7965e3ed-fccb-4f18-a2c8-d79447448c2a admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.158565 Mar 08 19:06:38.979983 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 28/54] 10.222.0.75 () {64 vars in 1235 bytes} [Tue Mar 8 19:06:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:06:40.241881 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:40.242890 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Mar 08 19:06:40.243283 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 27/55] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:06:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:40.436675 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-953a34ab-600c-42de-93ad-7d170c2f3f2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:40.556225 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-953a34ab-600c-42de-93ad-7d170c2f3f2e admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.171128 Mar 08 19:06:40.556702 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 29/56] 10.222.0.75 () {64 vars in 1235 bytes} [Tue Mar 8 19:06:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:06:41.824981 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:41.826017 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Mar 08 19:06:41.826408 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 28/57] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:06:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:42.014182 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-dafcce07-094c-48c3-8900-b2cd26a6bc04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:42.156370 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-dafcce07-094c-48c3-8900-b2cd26a6bc04 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.192803 Mar 08 19:06:42.162113 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 30/58] 10.222.0.75 () {64 vars in 1235 bytes} [Tue Mar 8 19:06:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:06:43.445374 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:43.446378 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Mar 08 19:06:43.446773 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 29/59] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:06:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:43.634923 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-769c0fc7-7614-45f7-b0f3-5f25071fc020 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:06:43.744732 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-769c0fc7-7614-45f7-b0f3-5f25071fc020 admin admin] 10.222.0.75 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.161409 Mar 08 19:06:43.745197 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 31/60] 10.222.0.75 () {64 vars in 1235 bytes} [Tue Mar 8 19:06:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:06:45.017628 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:45.018666 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Mar 08 19:06:45.019058 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 30/61] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:06:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:06:45.213923 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-b97d5341-9452-4c87-804c-14ca3cb04f36 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:06:45.233028 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-b97d5341-9452-4c87-804c-14ca3cb04f36 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076683 Mar 08 19:06:45.233559 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 32/62] 10.222.0.75 () {60 vars in 1202 bytes} [Tue Mar 8 19:06:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:07:37.172070 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:07:37.173083 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-b50bc3bc-e447-4c6f-8549-b2cfe3a5f089 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Mar 08 19:07:37.173476 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 31/63] 10.222.0.75 () {54 vars in 930 bytes} [Tue Mar 8 19:07:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:07:37.240539 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-8b6090c6-ba80-499f-8c49-58241213e1b6 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:07:37.259536 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-8b6090c6-ba80-499f-8c49-58241213e1b6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.079452 Mar 08 19:07:37.260098 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 33/64] 10.222.0.75 () {60 vars in 1291 bytes} [Tue Mar 8 19:07:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:07:37.282299 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-a3ec1da3-ba9b-4f82-a1ab-b35d2172f9f6 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:07:37.290300 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-a3ec1da3-ba9b-4f82-a1ab-b35d2172f9f6 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011616 Mar 08 19:07:37.290810 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 32/65] 10.222.0.75 () {60 vars in 1282 bytes} [Tue Mar 8 19:07:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:07:37.302450 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-7529bf12-76bf-416c-af01-ce0aaead4d44 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:07:37.310192 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-7529bf12-76bf-416c-af01-ce0aaead4d44 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011962 Mar 08 19:07:37.310704 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 34/66] 10.222.0.75 () {60 vars in 1285 bytes} [Tue Mar 8 19:07:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:07:37.322192 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-dc611237-c22a-4a17-b338-3d8e52b2d4ef admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:07:37.330095 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-dc611237-c22a-4a17-b338-3d8e52b2d4ef admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011730 Mar 08 19:07:37.330620 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 33/67] 10.222.0.75 () {60 vars in 1285 bytes} [Tue Mar 8 19:07:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:07:37.342239 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:07:37.350585 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] 10.222.0.75 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011904 Mar 08 19:07:37.351111 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 35/68] 10.222.0.75 () {60 vars in 1282 bytes} [Tue Mar 8 19:07:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:09:31.471817 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-da415863-27dc-474a-bcf9-396e909ef15c tempest-verify_tempest_config-381619782 tempest-verify_tempest_config-381619782-project] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:09:31.473812 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-da415863-27dc-474a-bcf9-396e909ef15c tempest-verify_tempest_config-381619782 tempest-verify_tempest_config-381619782-project] 10.222.0.75 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107773 Mar 08 19:09:31.474323 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 34/69] 10.222.0.75 () {58 vars in 1133 bytes} [Tue Mar 8 19:09:31 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:11:16.028715 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:11:16.029719 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Mar 08 19:11:16.030108 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 36/70] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:11:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:11:16.280326 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-037c05fe-8f59-4fcc-bdb0-4d1f32b412d3 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:11:16.281496 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:11:16.281496 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: warnings.warn(msg) Mar 08 19:11:16.282714 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-037c05fe-8f59-4fcc-bdb0-4d1f32b412d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:11:16.283169 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-037c05fe-8f59-4fcc-bdb0-4d1f32b412d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:11:16.284000 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-037c05fe-8f59-4fcc-bdb0-4d1f32b412d3 admin admin] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:11:16.284437 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-037c05fe-8f59-4fcc-bdb0-4d1f32b412d3 admin admin] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:11:16.318061 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-037c05fe-8f59-4fcc-bdb0-4d1f32b412d3 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.148860 Mar 08 19:11:16.318637 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 35/71] 10.222.0.75 () {60 vars in 1193 bytes} [Tue Mar 8 19:11:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:11:17.704271 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:11:17.705301 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Mar 08 19:11:17.705692 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 37/72] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:11:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:11:17.901373 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-608b15da-aa01-47d6-8c36-60f18973d6a8 admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:11:17.902537 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:11:17.902537 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: warnings.warn(msg) Mar 08 19:11:17.903735 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-608b15da-aa01-47d6-8c36-60f18973d6a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:11:17.904217 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-608b15da-aa01-47d6-8c36-60f18973d6a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:11:17.905046 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-608b15da-aa01-47d6-8c36-60f18973d6a8 admin admin] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:11:17.905479 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-608b15da-aa01-47d6-8c36-60f18973d6a8 admin admin] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:11:17.925195 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-608b15da-aa01-47d6-8c36-60f18973d6a8 admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076849 Mar 08 19:11:17.926045 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 36/73] 10.222.0.75 () {60 vars in 1193 bytes} [Tue Mar 8 19:11:17 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:11:29.764758 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:11:29.765772 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002190 Mar 08 19:11:29.766170 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 38/74] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:11:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:11:29.956789 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-beeeb953-4eca-4eee-9734-4b860273caac admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:11:29.957948 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:11:29.957948 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: warnings.warn(msg) Mar 08 19:11:29.959132 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-beeeb953-4eca-4eee-9734-4b860273caac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:11:29.959579 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-beeeb953-4eca-4eee-9734-4b860273caac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:11:29.960406 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-beeeb953-4eca-4eee-9734-4b860273caac admin admin] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:11:29.960837 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-beeeb953-4eca-4eee-9734-4b860273caac admin admin] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:11:29.986200 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-beeeb953-4eca-4eee-9734-4b860273caac admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082148 Mar 08 19:11:29.986691 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 37/75] 10.222.0.75 () {60 vars in 1193 bytes} [Tue Mar 8 19:11:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:11:31.342840 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: DEBUG nova.api.openstack.wsgi [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] Calling method '>' {{(pid=102906) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:11:31.343846 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: INFO nova.api.openstack.requestlog [None req-666d42ba-b19f-439e-9f8f-0e507482d076 admin admin] 10.222.0.75 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001623 Mar 08 19:11:31.344302 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: [pid: 102906|app: 0|req: 39/76] 10.222.0.75 () {56 vars in 1074 bytes} [Tue Mar 8 19:11:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:11:31.578639 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG nova.api.openstack.wsgi [None req-c655f579-c6f8-4709-a53a-b0aab6c4101c admin admin] Calling method '>' {{(pid=102905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:11:31.580307 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 08 19:11:31.580307 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: warnings.warn(msg) Mar 08 19:11:31.581965 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-c655f579-c6f8-4709-a53a-b0aab6c4101c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:11:31.582588 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-c655f579-c6f8-4709-a53a-b0aab6c4101c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:11:31.583886 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-c655f579-c6f8-4709-a53a-b0aab6c4101c admin admin] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:11:31.584648 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: DEBUG oslo_concurrency.lockutils [None req-c655f579-c6f8-4709-a53a-b0aab6c4101c admin admin] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:11:31.611212 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: INFO nova.api.openstack.requestlog [None req-c655f579-c6f8-4709-a53a-b0aab6c4101c admin admin] 10.222.0.75 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.095509 Mar 08 19:11:31.611790 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: [pid: 102905|app: 0|req: 38/77] 10.222.0.75 () {60 vars in 1193 bytes} [Tue Mar 8 19:11:31 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:12:33.056329 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: Tue Mar 8 19:12:33 2022 - graceful shutdown triggered... Mar 08 19:12:33.056214 dv-cinder-830091-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 08 19:12:33.061769 dv-cinder-830091-3-iscsi devstack@n-api.service[102906]: Gracefully killing worker 2 (pid: 102906)... Mar 08 19:12:33.062157 dv-cinder-830091-3-iscsi devstack@n-api.service[102905]: Gracefully killing worker 1 (pid: 102905)... Mar 08 19:12:34.057235 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: worker 1 buried after 1 seconds Mar 08 19:12:34.057235 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: worker 2 buried after 1 seconds Mar 08 19:12:34.057235 dv-cinder-830091-3-iscsi devstack@n-api.service[102904]: goodbye to uWSGI. Mar 08 19:12:34.058836 dv-cinder-830091-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 08 19:12:34.059406 dv-cinder-830091-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 08 19:12:34.062168 dv-cinder-830091-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 08 19:12:34.076082 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Mar 8 19:12:34 2022] *** Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: nodename: dv-cinder-830091-3-iscsi Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: machine: x86_64 Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: clock source: unix Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: pcre jit disabled Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: detected number of CPU cores: 4 Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: current working directory: / Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: detected binary path: /usr/bin/uwsgi-core Mar 08 19:12:34.090512 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: your processes number limit is 47680 Mar 08 19:12:34.091396 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: your memory page size is 4096 bytes Mar 08 19:12:34.091396 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: detected max file descriptor number: 2048 Mar 08 19:12:34.091396 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: lock engine: pthread robust mutexes Mar 08 19:12:34.091396 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: thunder lock: enabled Mar 08 19:12:34.091396 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 08 19:12:34.091396 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Mar 08 19:12:34.138833 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: Python main interpreter initialized at 0x55b866d829c0 Mar 08 19:12:34.138833 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: python threads support enabled Mar 08 19:12:34.138833 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: your server socket listen backlog is limited to 100 connections Mar 08 19:12:34.138833 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: your mercy for graceful operations on workers is 90 seconds Mar 08 19:12:34.139261 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: mapped 403077 bytes (393 KB) for 2 cores Mar 08 19:12:34.139261 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: *** Operational MODE: preforking *** Mar 08 19:12:34.139516 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: *** uWSGI is running in multiple interpreter mode *** Mar 08 19:12:34.139516 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: spawned uWSGI master process (pid: 117374) Mar 08 19:12:34.139723 dv-cinder-830091-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 08 19:12:34.142264 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: spawned uWSGI worker 1 (pid: 117390, cores: 1) Mar 08 19:12:34.142264 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: spawned uWSGI worker 2 (pid: 117391, cores: 1) Mar 08 19:12:34.142264 dv-cinder-830091-3-iscsi devstack@n-api.service[117374]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 08 19:12:36.105229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:12:36.105229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: from cryptography.utils import int_from_bytes Mar 08 19:12:36.105918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:12:36.105918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: from cryptography.utils import int_from_bytes Mar 08 19:12:36.106429 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:12:36.106429 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: from cryptography.utils import int_from_bytes Mar 08 19:12:36.106966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 08 19:12:36.106966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: from cryptography.utils import int_from_bytes Mar 08 19:12:38.551169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 19:12:38.551812 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 19:12:38.552115 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 19:12:38.552366 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 19:12:38.552606 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 19:12:38.553034 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.553327 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.553654 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.553982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.554317 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.554632 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.554960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.555308 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.555608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.555871 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.556227 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.556561 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830091-3-iscsi {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.556891 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.557203 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.557525 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.557854 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.558162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.558492 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.558806 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.559322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.560071 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.560391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.560717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.561065 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.561386 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.561706 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.562034 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.562350 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.562697 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.563003 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.563423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830091-3-iscsi {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.563756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.564109 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.564487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.565411 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.565744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.566169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.566508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.566843 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.567158 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.567487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.567818 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.568175 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.568503 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.568816 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.569132 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.569446 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.569779 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.570115 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.570406 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.570670 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.570993 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.571319 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.571647 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.572005 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.572277 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.572533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.572886 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.573215 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.573528 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.573842 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.574154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.574478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.574788 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.575102 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.575419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.575735 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.576368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.576766 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.577168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.577578 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.578831 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.578831 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.578831 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.579141 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.579556 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.579971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.580564 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.580931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.581282 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.581588 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.581906 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.582221 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.582553 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.582899 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.583214 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.583474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.583781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.584121 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.584452 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.586689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.586689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.586689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.586689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.586689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.586689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.586689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.587296 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.587296 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.587560 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.587876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.588216 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.588529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.588857 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.589185 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.589498 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.589840 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.590154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.590475 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.590804 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.591117 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.591426 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.591758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.592095 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.592409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.592733 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.593048 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.593361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.593687 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.593993 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.594306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.594630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.594964 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.595275 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.595584 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.595998 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.596256 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.596763 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.597083 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.597396 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.597704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.598033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.598364 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.598679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.598994 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.599306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.599634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.600014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.600351 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.600708 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.601032 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.601377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.601717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.602042 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.602363 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.602683 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.603017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.603334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.603649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.603997 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.604322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.604647 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.604985 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.605307 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.605632 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.605961 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.606278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.606602 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.606935 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.607260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.607580 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.607977 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.608299 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.608631 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.608950 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.609279 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.609595 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.609912 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.610231 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.610563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.610900 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.611219 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.612321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.612649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.612975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.613295 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.613615 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.613937 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.614284 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.614608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.614932 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.615254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.615579 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.615898 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.616242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.616559 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.616869 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.617184 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.617497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.617816 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.618125 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.618452 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.618787 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.619098 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.619443 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.619758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.620101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.620417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.620733 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.621044 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.621371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.621688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.621999 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.622331 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.622647 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.622958 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.623286 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.623597 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.623909 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.624253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.624571 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.624889 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.625212 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.625529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.625858 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.626177 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.626491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.626838 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.627734 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.628070 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.628489 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.628837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.629162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.629476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.629797 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.630116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.630418 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.630729 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.631045 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.631361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.631673 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.632007 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.632319 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.632628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.632962 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.633280 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.633591 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.633904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.634216 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.634570 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.634884 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.635238 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.635585 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.635944 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.639605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.639605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.639605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.639605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.639605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.639605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.639605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.639605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.640463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.640463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.640463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.640463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.640463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.640784 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.641019 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.641194 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.641536 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.641877 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.642203 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.642556 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.642916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.643240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.643612 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.643946 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.644346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.644599 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.644912 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.645234 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.645556 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.645869 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.646198 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.646516 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.646841 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.647151 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.647473 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.647811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.648185 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.648525 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.648846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.649176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.649493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.649812 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.650133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.650447 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.650762 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.651083 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.651408 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.651723 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.652064 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.652377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.652697 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.653012 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.653323 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.653631 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.653949 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.654278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.654594 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.654922 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.655250 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.655562 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.655874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.656229 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.656544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.656854 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.657163 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.657471 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.657824 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.658140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.658512 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.658837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.659163 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.659478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.659801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.660144 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.660460 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.660786 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.661112 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.661428 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.661742 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.662058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.662374 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.662689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.663018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.663332 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.663647 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.663983 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.664296 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.664613 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.664934 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.665524 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.665863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.666183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.666509 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.666836 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.667193 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.667497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.667576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 08 19:12:38.671575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 08 19:12:38.671668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.671668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.671820 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 08 19:12:38.671903 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.672121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 08 19:12:38.672215 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.672289 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 08 19:12:38.672360 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.672430 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.672500 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.672569 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.672652 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.672731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.672802 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.672802 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.673186 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.673267 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.673414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.673500 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.673572 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.673642 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.673711 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.674308 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.674385 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.674455 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.674534 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.674605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.674681 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.674765 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.674843 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.674915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.674999 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-830091-3-iscsi {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.675077 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.675168 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.675253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.675333 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.675417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.675489 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.675558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.675640 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.675712 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.675794 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.675871 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.675973 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.676049 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.676132 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.676211 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.676211 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.676352 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.676453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.676536 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.677882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.678049 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.678210 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.678360 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.678510 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.678674 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.678832 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.679002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.679158 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.679307 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.679456 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.679618 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.679775 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.679969 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.679969 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.680273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.680491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.680652 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.680810 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.680969 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-830091-3-iscsi {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.681134 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.681302 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.681462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.681611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.681767 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.681916 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.682073 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.682238 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.682396 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.682552 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.682700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.682856 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.683022 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.683272 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.683438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.683438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.683731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.683888 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.684063 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.684229 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.684386 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.684536 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.684685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.684834 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.684996 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.685167 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.685317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.685466 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.685622 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.685780 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.685944 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.686103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.686259 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.686409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.686565 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.686714 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.686872 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.687033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.687191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.687349 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.687499 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.687666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.687829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.688101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.688268 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.688419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.688575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.688739 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.688888 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.689041 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.689208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.689359 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.690214 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.690453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.690611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.690762 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.690912 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.691062 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.691237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.691400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.691559 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.691717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.691878 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.692136 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.692291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.692460 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.692736 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.692906 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.693058 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.693216 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.693468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.693631 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.693790 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.693941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.694100 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.694271 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.694428 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.694578 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.694735 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.694885 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.695041 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.695205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.695354 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.695511 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.695511 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.695802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.75 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.695802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.75 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.696163 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.696321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.696470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.696470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.696768 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.696933 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.697083 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.697240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.697390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.697545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.697708 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.697874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.698025 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.698192 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.698343 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.698343 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.698639 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.698802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.698960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.699117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.699274 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.699274 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.699557 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.699719 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.699869 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.699869 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.700201 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.700360 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.700520 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.700669 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.700817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.700974 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.701132 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.701298 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.701462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.701612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.701822 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.701983 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.702149 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.702309 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.702468 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.702617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.702774 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.702931 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.703090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.703240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.703403 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.703642 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.703798 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.703983 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.704151 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.704316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.704475 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.704631 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.704781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.704936 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.705168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.705341 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.705530 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.705684 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.706022 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.706183 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.706342 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.706502 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.706668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.706818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.706975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.707133 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.707284 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.707443 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.707593 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.707750 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.707910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.708086 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.708245 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.708406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.708557 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.708729 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.708893 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.709044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.709193 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.709349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.709500 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.709658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.709818 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.710013 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.710174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.710325 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.710474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.710638 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.710808 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.714735 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.714916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.715074 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.715234 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.715402 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.715562 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.715720 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.715720 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.716031 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.716193 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.716359 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.716508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.716678 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.716836 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.716993 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.717152 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.717310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.717458 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.717619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.717769 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.717918 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.718076 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.718234 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.718383 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.718551 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.718709 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.718868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.719027 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.719178 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.719326 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.719482 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.719631 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.719789 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.719996 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 08 19:12:38.720154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.720310 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.720461 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.720632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.720837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.721076 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.721232 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.721382 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.721542 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.721692 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.721863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.721863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.722158 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.722315 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.722478 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.722635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.722804 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.722955 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.723104 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.723104 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.723396 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.723554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.723704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.723853 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.724029 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.724192 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.724351 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.724519 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.724712 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.725920 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.726089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.726240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.726390 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.726621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.726775 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.726924 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.727081 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.727240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.727398 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.727558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.727710 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.727882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.728059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.728225 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.728386 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.728544 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.728694 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.728841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.729000 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.729157 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.729318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.729475 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.729626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.729773 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.729940 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.730097 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.730256 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.730407 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.730563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.730712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.730860 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.731008 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.731174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.731331 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.731481 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.731630 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.731790 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.731981 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.732145 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.732294 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.732452 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.732600 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.732758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.732917 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.733067 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.733215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.733215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.733215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.733215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.733782 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.733932 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.734091 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.734241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.734389 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.734547 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.734707 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.734857 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.735005 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.735164 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.735314 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.735477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.735628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.735797 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.736046 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.736214 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.736877 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.737040 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.737192 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.737349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.737544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.737702 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.737865 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.738029 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.738187 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.738336 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.738496 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.738645 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.738803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.738966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.739116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.739273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.739430 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.739579 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.739728 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.739896 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.740119 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.740270 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.740429 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.740586 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.740746 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.740904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.741055 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.741203 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.741361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.741518 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.741682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.741832 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.741982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.742174 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.742333 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.742501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.742666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.742815 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.742973 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.743130 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.743279 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.743437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.743589 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.743746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.743904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.744090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.744241 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.744399 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.744570 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.744720 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.744870 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.745028 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.745187 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.745346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.745504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.745504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.745803 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.745953 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.746199 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.746376 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.746537 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.746688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.746844 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.746995 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.747155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.747306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.747455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.747613 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.747762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.747972 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.748144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.748304 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.748453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.748621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.748621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.748904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.749062 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.749219 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.749380 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.749530 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.749680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.749830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.749830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.750132 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.750283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.750447 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.750613 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.750773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.750928 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.751079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.751236 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.751387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.751543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.751703 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.751852 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.752704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.752891 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.753064 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.753235 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.753473 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.753638 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.753789 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.753937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.754102 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.754260 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.754428 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.754587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.754738 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.754895 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.755053 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.755202 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.755361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.755523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.755673 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.755822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.756011 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.756199 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.756432 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.756599 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.756757 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.756905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.757063 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.757291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.757291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.757605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.757763 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.757913 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.758063 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.758226 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.758384 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.758534 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.758534 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.758826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.758984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.759142 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.759300 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.759449 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.759616 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.759781 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.759972 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.760128 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.760322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.760481 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.760638 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.760788 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.760954 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.761113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.761263 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.761412 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.761576 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.761734 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.761903 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.762061 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.762219 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.762376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.762541 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.762703 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.762854 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.763002 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.763002 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.763284 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.763457 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.763617 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.763774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.763969 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.764126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.764288 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.764445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.764605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.765030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.765199 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.765360 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.765509 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.765667 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.765826 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.765975 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.766132 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.766282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.766448 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.766683 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.766853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.766853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.767147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.767147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.767445 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.767658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.767844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.767844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.768183 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.768346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.768506 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.768506 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.768800 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.768800 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.769090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.769248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.769415 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.769675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.769840 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.769840 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.770146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.770305 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.770464 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.770613 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.770771 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.770920 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.771078 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.771237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.771397 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.771554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.771704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.771853 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.772038 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.772203 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.772363 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.772520 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.772681 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.772831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.773000 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.773284 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.773463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.773615 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.773774 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.773932 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.774127 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.774302 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.774454 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.774603 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.774752 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.774900 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.775058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.775221 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.775371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.775528 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.775679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.775828 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.775828 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.776236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.776389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.776547 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.776723 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.776961 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.777130 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.777282 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.777440 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.777598 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.777748 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.777897 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.778056 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.778208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.778376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.778529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.778687 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.778687 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.778986 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.779144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.779295 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.779452 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.779610 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.779770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.779941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.780107 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.780266 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.780431 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.780589 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.780749 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.780907 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.781057 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.781206 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.781206 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.781505 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.781664 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.781824 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.781981 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.782130 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.782130 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.782425 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.782599 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.782757 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.782757 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.783058 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.783254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.783416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.783575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.783731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.783882 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.784066 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.784219 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.784395 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.784548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.784697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.784848 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.785015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.785183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.785183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.785484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.785634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.785789 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.785955 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.786105 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.786255 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.786416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.786573 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.786730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.786890 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.787163 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.787328 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.787478 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.787635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.787793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.788011 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.788168 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.788318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.788467 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.788634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.788799 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.788957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.789107 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.789263 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.789426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.789576 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.789725 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.789883 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.790034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.790193 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.790353 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.790503 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.790662 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.790662 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.790955 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.791118 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.791287 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.791444 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.791594 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.791751 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.791908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.792095 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.792247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.792396 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.792566 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.792732 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.793018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.793018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.793350 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.793509 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.793667 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.793817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.793974 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.794139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.794296 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.794447 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.794604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.794767 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.794924 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.795084 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.795242 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.795401 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.795559 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.795709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.795871 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.796057 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.796217 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.796377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.796536 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.796706 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.796865 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.797024 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.797265 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.797420 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.797578 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.797728 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.797887 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.798050 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.798207 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.798357 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.798515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.798679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.799372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.799533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.799685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.799835 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.800004 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.800170 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.800334 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.800486 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.800636 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.800786 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.800935 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.801093 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.801242 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.801410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.801561 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.801719 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.801879 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.802039 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.802189 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.802339 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.802487 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.802487 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.802793 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.802957 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.803117 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.803277 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.803428 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.803630 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.803825 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.804009 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.804167 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.804316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.804474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.804624 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.804787 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.804940 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.805089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.805320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.805540 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.805699 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.805859 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.806009 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.806159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.806317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.806467 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.806626 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.806785 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.806935 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.806935 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.807246 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.807495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.807667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.807667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.808036 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.808194 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.808354 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.808515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.808666 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.808817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.808973 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.809133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.809283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.809442 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.809610 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.809761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.809918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.809918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.810220 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.810384 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.810535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.810685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.810842 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.811001 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.811160 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.811319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.811479 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.811646 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.811805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.811972 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.812212 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.812212 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.812509 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.812667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.812826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.812995 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.813156 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.813315 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.813472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.813637 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.813798 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.813949 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.814112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.814264 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.814466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.815124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.815290 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.815441 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.815600 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.815760 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.815910 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.816096 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.816258 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.816424 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.816575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.816725 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.816883 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.817034 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.817191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.817350 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.817518 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.817763 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.817918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.818069 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.818226 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.818407 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.818560 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.818717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.818867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.819024 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.819181 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.819345 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.819506 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.819671 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.819829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.820043 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.820278 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.820439 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.820601 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.820759 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.820910 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.821060 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.821224 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.821374 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.821531 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.821683 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.821838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.821988 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.822151 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.822303 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.822453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.822613 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.822771 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.822927 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.823088 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.823247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.823397 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.823547 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.823699 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.823864 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.824049 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.824209 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.824359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.824528 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.824680 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.824846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.824998 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.825147 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.825297 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.825447 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.825597 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.825761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.825761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.826050 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.826050 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.826351 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.826524 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.826684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.826835 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.826985 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.827142 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.827300 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.827463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.827615 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.827789 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.828072 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.828229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.828380 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.828558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.828712 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.828874 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.829024 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.829173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.829323 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.829487 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.829638 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.829788 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.829945 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.830421 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.830593 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.830752 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.830915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.830915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 19:12:38.831213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.831213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.831213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.831213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.831213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.831213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.831213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.831213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.832394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.832394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.832394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.832394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.832394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.832394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.832394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.832394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.833575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.833575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.833575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.833575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.833575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.833575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.833575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.833575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.834772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.834772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.834772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.834772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.834772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.834772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.834772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.834772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.836003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.836003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.836003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.836003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.836003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.836003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.836003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.836003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.837155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.837155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.837155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.837155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.837155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.837155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.837155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.837155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.838406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.838406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.838406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.838406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.838406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.838406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.838406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.838406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.839543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.839543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.839543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.842904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.842904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.842904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.842904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.842904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.844665 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.844665 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.844914 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.845192 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.845545 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.846426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.846757 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.847083 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.847235 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_db.sqlalchemy.engines [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:12:38.847487 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.847772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.848129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.848627 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.848952 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.849303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.849631 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.850037 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.850314 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.850642 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.850967 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.851309 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.851622 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.852021 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.852297 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.852612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.852923 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.853232 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.853548 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.853855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.854170 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.854479 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.854842 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.855157 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.855486 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.855869 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.856178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.856571 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.856795 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.857147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.857456 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.857794 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.858123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.858477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.858809 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.859122 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.859451 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.859771 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.860126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.860446 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.860765 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.861082 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.861966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.862292 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.862606 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.862927 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.863246 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.863567 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.864170 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.864501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.864818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.865134 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.865447 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.865761 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.866077 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.866389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.866702 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.867016 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.867330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.867713 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.868059 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.868397 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.868740 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.869059 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.869379 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.869697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.870012 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.870379 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.870699 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.871007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.871321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.871642 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.871983 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.872473 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.872792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.873109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.873507 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.873826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.874146 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.874463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.874779 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.875109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.875448 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.875768 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.876111 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.876428 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.876747 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.877338 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.877656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.877994 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.878320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.878656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.878971 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.879290 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.879621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.879943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.880263 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.880571 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.880881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.881186 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.881509 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.881821 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.882129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.882453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.882763 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.883303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.883656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.883994 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.884330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.884658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.884976 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.885283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.885611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.885918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.886223 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.886539 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.886851 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.887160 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.887472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.887780 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.888113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.888417 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.888730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.889037 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.889368 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.889938 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.890246 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.890558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.890867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.891177 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.891484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.891791 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.892126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.892440 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.892782 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.893241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.893551 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.893868 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.894180 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.894494 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.894847 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.895182 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.895490 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.895798 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.896160 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.896475 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.896802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.897117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.897428 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.897831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.898157 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.898742 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.899086 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.899404 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.899754 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.900192 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.900513 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.900827 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.901139 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.901468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.901783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.902096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.902467 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.902786 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.903099 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.903802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.903802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.904045 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.904527 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.904846 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.905159 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.905565 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.905793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.906147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.906476 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.906797 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.907116 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.907440 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.907778 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.908122 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.908953 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.909269 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.909604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.909940 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.910270 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.910545 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.910988 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.911305 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.911631 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.911966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.912282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.912611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.912939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.913254 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.913576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.913889 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.914222 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.914576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.914910 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.915240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.915549 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.916519 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.916519 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.916519 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.917018 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.917172 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.917405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.917709 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.918010 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.918307 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.918880 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.919188 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.919495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.926480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.926480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.926480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.926480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.926480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.926480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.926480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.926480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.927767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.927767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.927767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.927767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.927767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.927767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.927767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.927767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.928612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.928612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.928612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.928612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.928612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.928612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.928612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.928612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.929241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.929241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.929241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.929241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.929241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.929623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.929818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.930152 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.930483 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.930793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.931123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.931444 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.931774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.932112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.932430 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.932763 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.933080 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.933391 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.933714 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.934023 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.934337 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.934490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.context [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54c5021f-2f67-450e-b2bf-a7af4b069dbb(cell1) {{(pid=117391) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 19:12:38.934661 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.934978 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.935312 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.935645 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.936015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.936350 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.936708 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.937115 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.937528 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.937866 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.938218 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.938496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.938839 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 08 19:12:38.938941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:12:38.939032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 08 19:12:38.941169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:12:38.942029 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:12:38.944058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:12:38.955788 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_db.sqlalchemy.engines [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:12:38.957025 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_db.sqlalchemy.engines [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:12:38.963320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_db.sqlalchemy.engines [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:12:39.030025 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.context [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),54c5021f-2f67-450e-b2bf-a7af4b069dbb(cell1) {{(pid=117390) load_cells /opt/stack/nova/nova/context.py:464}} Mar 08 19:12:39.035113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:12:39.036750 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:12:39.041593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:12:39.041593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:12:39.053366 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_db.sqlalchemy.engines [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:12:39.055428 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_db.sqlalchemy.engines [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:12:39.128134 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_db.sqlalchemy.engines [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:12:39.216412 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_db.sqlalchemy.engines [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 08 19:12:39.453773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: WARNING keystonemiddleware.auth_token [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:12:39.540728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: WARNING keystonemiddleware.auth_token [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:12:39.577499 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: WARNING keystonemiddleware.auth_token [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:12:39.663069 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: WARNING keystonemiddleware.auth_token [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:12:39.809559 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: WARNING keystonemiddleware.auth_token [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:12:39.815055 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: WARNING keystonemiddleware.auth_token [None req-44fff649-1f99-4eeb-83e6-5fc3bda744e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:12:39.820435 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b866d829c0 pid: 117391 (default app) Mar 08 19:12:39.895431 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: WARNING keystonemiddleware.auth_token [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 08 19:12:39.901125 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: WARNING keystonemiddleware.auth_token [None req-efb36339-655c-4619-ba80-bfea06a29d45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 08 19:12:39.906512 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b866d829c0 pid: 117390 (default app) Mar 08 19:13:22.737886 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-68ed2714-85f2-492d-b899-03075f7ecc65 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Action: 'create', calling method: .version_select at 0x7f4391e3c160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1565184089", "metadata": {"Type": "work"}}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:22.737886 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-68ed2714-85f2-492d-b899-03075f7ecc65 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:22.737886 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-68ed2714-85f2-492d-b899-03075f7ecc65 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.868759 Mar 08 19:13:22.737886 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 1/1] 10.222.0.75 () {60 vars in 1155 bytes} [Tue Mar 8 19:13:21 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 871 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:13:22.788596 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-551421605", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "networks": [{"uuid": "f176316a-dcf0-4ff8-9d04-4117d60f21a4"}]}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:22.960952 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8f7dc8d7-3d6d-4c9a-b640-c3995d334745 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Action: 'create', calling method: .version_select at 0x7f4391e3d160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1727428062"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:23.384432 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] validate_networks() for [('f176316a-dcf0-4ff8-9d04-4117d60f21a4', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:13:24.328615 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:13:24.329089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:13:24.329652 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:13:24.330820 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:13:24.331324 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:13:24.346322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:24.348238 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:24.349170 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:24.349638 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:24.398801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Getting quotas for project ba7a7a1ddfb54eaa8b255267ec4bde13. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:24.405891 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Getting quotas for user 4b91a82b4bb5482e9ff050596a43aacf and project ba7a7a1ddfb54eaa8b255267ec4bde13. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:24.421684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:13:24.425255 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:13:24.620423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-04b4016e-06c0-4de0-a744-071b8b01b4b8 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.886036 Mar 08 19:13:24.620702 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8f7dc8d7-3d6d-4c9a-b640-c3995d334745 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.560253 Mar 08 19:13:24.621524 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 2/2] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:13:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:13:24.623635 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 1/3] 10.222.0.75 () {60 vars in 1154 bytes} [Tue Mar 8 19:13:22 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2565 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Mar 08 19:13:24.635540 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-95a8cf95-5192-4d1d-9d59-0feb0e0a6306 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:24.635892 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-02d87059-9516-48a3-ba7e-f0ba9784d6c0 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Action: 'create', calling method: .version_select at 0x7f4391450040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1967950933", "metadata": {"Type": "work"}}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:24.636321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-95a8cf95-5192-4d1d-9d59-0feb0e0a6306 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:24.646854 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-02d87059-9516-48a3-ba7e-f0ba9784d6c0 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:24.648056 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-02d87059-9516-48a3-ba7e-f0ba9784d6c0 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.025211 Mar 08 19:13:24.649118 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 3/4] 10.222.0.75 () {60 vars in 1155 bytes} [Tue Mar 8 19:13:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:13:24.654417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9e560e2a-4fb9-44e8-b79a-80b3a7e4e54e tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4391e3cb80>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:24.799637 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9e560e2a-4fb9-44e8-b79a-80b3a7e4e54e tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee" status: 200 len: 345 microversion: 2.1 time: 0.149287 Mar 08 19:13:24.800223 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 4/5] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:24 2022] GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee => generated 345 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:24.809278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cc4541e7-55cf-4e00-9415-a33906e4c915 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Action: 'create', calling method: .version_select at 0x7f4390c269d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-286434439", "metadata": {"Type": "work"}}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:24.810880 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cc4541e7-55cf-4e00-9415-a33906e4c915 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:24.812304 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cc4541e7-55cf-4e00-9415-a33906e4c915 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010849 Mar 08 19:13:24.813883 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 5/6] 10.222.0.75 () {60 vars in 1155 bytes} [Tue Mar 8 19:13:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:13:24.823805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e1de2d74-0733-4993-9afc-4bdc22380d31 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Calling method '.version_select at 0x7f4390c2e820>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:24.902107 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-e1de2d74-0733-4993-9afc-4bdc22380d31 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] HTTP exception thrown: Volume tempest-invalid-1432364746 could not be found. Mar 08 19:13:24.902979 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e1de2d74-0733-4993-9afc-4bdc22380d31 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Returning 404 to user: Volume tempest-invalid-1432364746 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:24.904085 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e1de2d74-0733-4993-9afc-4bdc22380d31 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1432364746" status: 404 len: 99 microversion: 2.1 time: 0.084572 Mar 08 19:13:24.904955 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 6/7] 10.222.0.75 () {58 vars in 1217 bytes} [Tue Mar 8 19:13:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1432364746 => generated 99 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Mar 08 19:13:24.915676 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-27df276b-a53f-469c-9701-e9253525b360 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004555 Mar 08 19:13:24.918728 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 7/8] 10.222.0.75 () {58 vars in 1139 bytes} [Tue Mar 8 19:13:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Mar 08 19:13:24.929745 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-95a8cf95-5192-4d1d-9d59-0feb0e0a6306 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:24.941556 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-255d57cc-ac06-491b-9086-8d05a9374fde tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012209 Mar 08 19:13:24.942518 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 8/9] 10.222.0.75 () {58 vars in 1136 bytes} [Tue Mar 8 19:13:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 08 19:13:24.952913 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce0eeb21-158c-44ea-92a1-72879c70a310 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Calling method '.version_select at 0x7f4391432a60>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:24.956349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-95a8cf95-5192-4d1d-9d59-0feb0e0a6306 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1214 microversion: 2.1 time: 0.327443 Mar 08 19:13:24.962926 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 2/10] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:24 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1214 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:25.016859 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-ce0eeb21-158c-44ea-92a1-72879c70a310 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] HTTP exception thrown: Volume ddf8f464-f93d-4821-bbcb-75041e9aed31 could not be found. Mar 08 19:13:25.025005 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce0eeb21-158c-44ea-92a1-72879c70a310 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Returning 404 to user: Volume ddf8f464-f93d-4821-bbcb-75041e9aed31 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:25.025005 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ce0eeb21-158c-44ea-92a1-72879c70a310 tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/ddf8f464-f93d-4821-bbcb-75041e9aed31" status: 404 len: 109 microversion: 2.1 time: 0.070675 Mar 08 19:13:25.025005 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 9/11] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:13:24 2022] DELETE /compute/v2.1/os-volumes/ddf8f464-f93d-4821-bbcb-75041e9aed31 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:13:25.035154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ac628282-e7db-4005-bb22-f6f3f330a82f tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Calling method '.version_select at 0x7f4391d16670>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:25.075111 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-ac628282-e7db-4005-bb22-f6f3f330a82f tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] HTTP exception thrown: Volume 32a367a9-9e12-4a84-9246-552b5ea8eb57 could not be found. Mar 08 19:13:25.077225 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ac628282-e7db-4005-bb22-f6f3f330a82f tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] Returning 404 to user: Volume 32a367a9-9e12-4a84-9246-552b5ea8eb57 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:25.078193 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ac628282-e7db-4005-bb22-f6f3f330a82f tempest-VolumesNegativeTest-1554550945 tempest-VolumesNegativeTest-1554550945-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/32a367a9-9e12-4a84-9246-552b5ea8eb57" status: 404 len: 109 microversion: 2.1 time: 0.048606 Mar 08 19:13:25.078751 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 3/12] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:25 2022] GET /compute/v2.1/os-volumes/32a367a9-9e12-4a84-9246-552b5ea8eb57 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:13:25.813372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-db01f457-db77-4046-92e5-7c31e5dce8ec tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390c269d0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:25.959781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-db01f457-db77-4046-92e5-7c31e5dce8ec tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee" status: 200 len: 345 microversion: 2.1 time: 0.151311 Mar 08 19:13:25.960410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 10/13] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:25 2022] GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee => generated 345 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:25.982050 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-87e639cf-0056-47a8-8960-a3b560ed6ea3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:25.982050 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-87e639cf-0056-47a8-8960-a3b560ed6ea3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:26.078778 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-87e639cf-0056-47a8-8960-a3b560ed6ea3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:26.087054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-87e639cf-0056-47a8-8960-a3b560ed6ea3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1214 microversion: 2.1 time: 0.112177 Mar 08 19:13:26.090407 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 4/14] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:25 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:26.972428 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ea8b6874-7a4e-4824-9ed0-ae8298413914 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390c2e5e0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:27.068826 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ea8b6874-7a4e-4824-9ed0-ae8298413914 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee" status: 200 len: 346 microversion: 2.1 time: 0.099510 Mar 08 19:13:27.076031 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 11/15] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:26 2022] GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:27.082156 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-af694e5c-6df2-44de-b096-d7817743e844 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Action: 'create', calling method: .version_select at 0x7f4391cee790>, body: {"snapshot": {"volume_id": "1dabe16c-b01f-488d-9142-d38e78898fee", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2057386166"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:27.107791 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-47cb275a-23c7-4853-b3c2-814ba31457a4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:27.110217 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-47cb275a-23c7-4853-b3c2-814ba31457a4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:27.134626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-47cb275a-23c7-4853-b3c2-814ba31457a4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:27.137120 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-47cb275a-23c7-4853-b3c2-814ba31457a4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:27.137120 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-47cb275a-23c7-4853-b3c2-814ba31457a4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:27.164222 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-47cb275a-23c7-4853-b3c2-814ba31457a4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:27.744067 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-47cb275a-23c7-4853-b3c2-814ba31457a4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:27.805381 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-47cb275a-23c7-4853-b3c2-814ba31457a4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1218 microversion: 2.1 time: 0.702480 Mar 08 19:13:27.807864 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 12/16] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:27 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1218 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:13:27.994268 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-af694e5c-6df2-44de-b096-d7817743e844 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.915987 Mar 08 19:13:27.996587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 5/17] 10.222.0.75 () {60 vars in 1161 bytes} [Tue Mar 8 19:13:27 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:28.014722 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fb59f77e-86f4-42e0-a1d9-d834f8765bfe tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390baa9d0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:28.301837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fb59f77e-86f4-42e0-a1d9-d834f8765bfe tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.142380 Mar 08 19:13:28.301837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 13/18] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:28 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:28.346032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-03a8bc1d-50a6-4a05-b9a2-cd95078a56f7 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4391ceeee0>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:28.346032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-03a8bc1d-50a6-4a05-b9a2-cd95078a56f7 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.095334 Mar 08 19:13:28.348774 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e8585b02-8028-4118-87c6-44c9e81230f0 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b47430>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:28.352887 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 6/19] 10.222.0.75 () {58 vars in 1139 bytes} [Tue Mar 8 19:13:28 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:28.353183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e8585b02-8028-4118-87c6-44c9e81230f0 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.079871 Mar 08 19:13:28.353183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 14/20] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:28 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:28.830653 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c2881cf1-c7df-4d17-965f-cd43fa8a916c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:28.830653 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c2881cf1-c7df-4d17-965f-cd43fa8a916c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:28.849044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c2881cf1-c7df-4d17-965f-cd43fa8a916c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:28.853793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c2881cf1-c7df-4d17-965f-cd43fa8a916c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:28.859809 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c2881cf1-c7df-4d17-965f-cd43fa8a916c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:28.860298 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c2881cf1-c7df-4d17-965f-cd43fa8a916c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:29.247710 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c2881cf1-c7df-4d17-965f-cd43fa8a916c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:29.266347 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c2881cf1-c7df-4d17-965f-cd43fa8a916c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1266 microversion: 2.1 time: 0.442537 Mar 08 19:13:29.279147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 7/21] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:28 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1266 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:29.350909 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a9563b71-babf-4401-a68a-9fad139709c3 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b478b0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:29.399645 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a9563b71-babf-4401-a68a-9fad139709c3 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.052449 Mar 08 19:13:29.404326 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 15/22] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:29 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:30.287661 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-acb63139-6a81-489c-aeb9-07ebcc9ffc6d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:30.289021 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-acb63139-6a81-489c-aeb9-07ebcc9ffc6d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:30.300320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-acb63139-6a81-489c-aeb9-07ebcc9ffc6d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:30.301048 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-acb63139-6a81-489c-aeb9-07ebcc9ffc6d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:30.302033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-acb63139-6a81-489c-aeb9-07ebcc9ffc6d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:30.302633 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-acb63139-6a81-489c-aeb9-07ebcc9ffc6d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:30.413477 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-451fc7d9-5be7-46e7-b4b1-4e2c9b672d31 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b47040>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:30.464385 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-451fc7d9-5be7-46e7-b4b1-4e2c9b672d31 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.054882 Mar 08 19:13:30.469587 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 16/23] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:30 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:30.479816 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-acb63139-6a81-489c-aeb9-07ebcc9ffc6d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:30.488266 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-acb63139-6a81-489c-aeb9-07ebcc9ffc6d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1266 microversion: 2.1 time: 0.204497 Mar 08 19:13:30.492731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 8/24] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:30 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:31.477002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a3560728-af15-474b-ac22-e3e38b7e4c74 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b47280>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:31.505315 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-734751eb-2c01-45c6-913a-3ad293632ca1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:31.505926 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-734751eb-2c01-45c6-913a-3ad293632ca1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:31.513024 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-734751eb-2c01-45c6-913a-3ad293632ca1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:31.513880 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-734751eb-2c01-45c6-913a-3ad293632ca1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:31.514793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-734751eb-2c01-45c6-913a-3ad293632ca1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:31.515397 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-734751eb-2c01-45c6-913a-3ad293632ca1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:31.530552 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a3560728-af15-474b-ac22-e3e38b7e4c74 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.056725 Mar 08 19:13:31.532273 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 17/25] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:31 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:31.750411 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-734751eb-2c01-45c6-913a-3ad293632ca1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:31.770299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-734751eb-2c01-45c6-913a-3ad293632ca1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1266 microversion: 2.1 time: 0.268733 Mar 08 19:13:31.771628 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 9/26] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:31 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:32.544349 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4125fcd3-d8ab-4b06-ab6c-587f034999e4 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390baab80>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:32.593438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4125fcd3-d8ab-4b06-ab6c-587f034999e4 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.053119 Mar 08 19:13:32.595310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 18/27] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:32 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:32.790536 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-856757fc-520a-4e6a-aca7-230f3a71e288 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:32.797774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-856757fc-520a-4e6a-aca7-230f3a71e288 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:32.820491 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-856757fc-520a-4e6a-aca7-230f3a71e288 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:32.821416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-856757fc-520a-4e6a-aca7-230f3a71e288 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:32.822476 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-856757fc-520a-4e6a-aca7-230f3a71e288 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:32.830483 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-856757fc-520a-4e6a-aca7-230f3a71e288 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:32.979954 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-856757fc-520a-4e6a-aca7-230f3a71e288 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:32.984549 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-856757fc-520a-4e6a-aca7-230f3a71e288 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1266 microversion: 2.1 time: 0.197589 Mar 08 19:13:32.988195 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 10/28] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:32 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:33.607956 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2d8f8959-0695-4b66-9610-86610d8625b7 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b6b670>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:33.690277 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2d8f8959-0695-4b66-9610-86610d8625b7 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.087965 Mar 08 19:13:33.691320 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 19/29] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:33 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:34.001786 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e026b513-6ff9-42de-b6e3-2d9f2ad99060 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:34.003340 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e026b513-6ff9-42de-b6e3-2d9f2ad99060 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:34.014481 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e026b513-6ff9-42de-b6e3-2d9f2ad99060 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:34.014935 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e026b513-6ff9-42de-b6e3-2d9f2ad99060 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:34.016359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e026b513-6ff9-42de-b6e3-2d9f2ad99060 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:34.017216 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e026b513-6ff9-42de-b6e3-2d9f2ad99060 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:34.120523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e026b513-6ff9-42de-b6e3-2d9f2ad99060 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:34.128033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e026b513-6ff9-42de-b6e3-2d9f2ad99060 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1274 microversion: 2.1 time: 0.130137 Mar 08 19:13:34.136157 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 11/30] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:33 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:34.716746 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-bab87607-36b7-4ed5-963c-450f21e640e1 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b6bca0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:34.772307 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-bab87607-36b7-4ed5-963c-450f21e640e1 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 288 microversion: 2.1 time: 0.068265 Mar 08 19:13:34.774982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 20/31] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:34 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 288 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:34.797345 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f873c8c2-7e7c-410f-866d-a2e88076cd7a tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4391c1cd30>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:34.996077 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f873c8c2-7e7c-410f-866d-a2e88076cd7a tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "DELETE /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 202 len: 0 microversion: 2.1 time: 0.216312 Mar 08 19:13:35.000225 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 12/32] 10.222.0.75 () {58 vars in 1253 bytes} [Tue Mar 8 19:13:34 2022] DELETE /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:13:35.008779 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4da64b6b-36ea-4150-8219-802c54ceaeed tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390baab80>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:35.067560 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4da64b6b-36ea-4150-8219-802c54ceaeed tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.062693 Mar 08 19:13:35.068265 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 21/33] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:35 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:35.162586 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-402efa1e-40bc-4dc4-a013-2c7ce5f6b5ef tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:35.173198 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-402efa1e-40bc-4dc4-a013-2c7ce5f6b5ef tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:35.182649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-402efa1e-40bc-4dc4-a013-2c7ce5f6b5ef tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:35.183106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-402efa1e-40bc-4dc4-a013-2c7ce5f6b5ef tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:35.184946 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-402efa1e-40bc-4dc4-a013-2c7ce5f6b5ef tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:35.185428 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-402efa1e-40bc-4dc4-a013-2c7ce5f6b5ef tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:35.442886 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-402efa1e-40bc-4dc4-a013-2c7ce5f6b5ef tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:35.456071 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-402efa1e-40bc-4dc4-a013-2c7ce5f6b5ef tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1272 microversion: 2.1 time: 0.304839 Mar 08 19:13:35.456705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 13/34] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:35 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1272 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:36.083899 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9062acfb-25ab-4720-a477-8ee150a8d732 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b47280>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:36.150909 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9062acfb-25ab-4720-a477-8ee150a8d732 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.075237 Mar 08 19:13:36.155265 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 22/35] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:36 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:36.419489 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a6039724-77f4-4fd7-8cc1-d96ad5701ac7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'create', calling method: .version_select at 0x7f4391c2de50>, body: {"keypair": {"name": "tempest-keypair-1874096190"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:36.484694 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce104a02-a7e2-424a-91b2-e0902820d329 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:36.486103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ce104a02-a7e2-424a-91b2-e0902820d329 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:36.501821 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-a6039724-77f4-4fd7-8cc1-d96ad5701ac7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for project 011362b6715747dba59bf9619c6bd65b. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:36.507546 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce104a02-a7e2-424a-91b2-e0902820d329 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:36.509076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce104a02-a7e2-424a-91b2-e0902820d329 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:36.510917 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce104a02-a7e2-424a-91b2-e0902820d329 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:36.512263 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-a6039724-77f4-4fd7-8cc1-d96ad5701ac7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for user 3b060e4c794d46009e926c8078045d8c and project 011362b6715747dba59bf9619c6bd65b. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:36.512957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce104a02-a7e2-424a-91b2-e0902820d329 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:36.604101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ce104a02-a7e2-424a-91b2-e0902820d329 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:36.628225 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ce104a02-a7e2-424a-91b2-e0902820d329 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1272 microversion: 2.1 time: 0.144456 Mar 08 19:13:36.636325 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 23/36] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:36 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1272 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:37.126649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-a6039724-77f4-4fd7-8cc1-d96ad5701ac7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for project 011362b6715747dba59bf9619c6bd65b. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:37.133042 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-a6039724-77f4-4fd7-8cc1-d96ad5701ac7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for user 3b060e4c794d46009e926c8078045d8c and project 011362b6715747dba59bf9619c6bd65b. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:37.152672 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a6039724-77f4-4fd7-8cc1-d96ad5701ac7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.937251 Mar 08 19:13:37.154185 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 14/37] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:13:36 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:37.167485 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-557b8383-772c-4332-b3c0-262c33c74202 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b0c280>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:37.220982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-557b8383-772c-4332-b3c0-262c33c74202 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.059682 Mar 08 19:13:37.222656 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 24/38] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:37 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:37.643641 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5cdcabab-f131-46ac-b680-207cd5e2b3e0 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:37.644758 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5cdcabab-f131-46ac-b680-207cd5e2b3e0 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:37.654705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5cdcabab-f131-46ac-b680-207cd5e2b3e0 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:37.655449 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5cdcabab-f131-46ac-b680-207cd5e2b3e0 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:37.656923 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5cdcabab-f131-46ac-b680-207cd5e2b3e0 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:37.657453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5cdcabab-f131-46ac-b680-207cd5e2b3e0 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:37.989416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5cdcabab-f131-46ac-b680-207cd5e2b3e0 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:38.049227 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5cdcabab-f131-46ac-b680-207cd5e2b3e0 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1272 microversion: 2.1 time: 0.409853 Mar 08 19:13:38.066471 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 15/39] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:37 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1272 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:38.234131 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-40b6586e-5dbf-4594-8ec0-4071aa29abab tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4390b0c1f0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:38.309520 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-40b6586e-5dbf-4594-8ec0-4071aa29abab tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 200 len: 287 microversion: 2.1 time: 0.079330 Mar 08 19:13:38.310683 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 25/40] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:38 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:38.388720 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9d1d5d18-e816-4149-b65e-9578f50185a8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'create', calling method: .version_select at 0x7f439134e700>, body: {"keypair": {"name": "tempest-keypair-1334597916"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:38.429257 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-9d1d5d18-e816-4149-b65e-9578f50185a8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:38.444658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-9d1d5d18-e816-4149-b65e-9578f50185a8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for user 86324e490e1041088722ab5fc5df4e91 and project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:38.540185 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1194843298", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:38.650177 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] validate_networks() for [('57635741-7850-4fb8-8caf-3cc49a276e9c', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:13:39.072054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-9d1d5d18-e816-4149-b65e-9578f50185a8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:39.082391 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-9d1d5d18-e816-4149-b65e-9578f50185a8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for user 86324e490e1041088722ab5fc5df4e91 and project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:39.117051 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9d1d5d18-e816-4149-b65e-9578f50185a8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.846999 Mar 08 19:13:39.122568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 16/41] 10.222.0.75 () {62 vars in 1198 bytes} [Tue Mar 8 19:13:38 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 849 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 08 19:13:39.127594 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7407bfcd-8bcc-4b75-b6e5-08c8adfe2c47 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:39.128254 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7407bfcd-8bcc-4b75-b6e5-08c8adfe2c47 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:39.145201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7407bfcd-8bcc-4b75-b6e5-08c8adfe2c47 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:39.145651 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7407bfcd-8bcc-4b75-b6e5-08c8adfe2c47 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:39.146441 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7407bfcd-8bcc-4b75-b6e5-08c8adfe2c47 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:39.146925 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7407bfcd-8bcc-4b75-b6e5-08c8adfe2c47 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:39.542784 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7407bfcd-8bcc-4b75-b6e5-08c8adfe2c47 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:39.551775 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7407bfcd-8bcc-4b75-b6e5-08c8adfe2c47 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1272 microversion: 2.1 time: 0.432482 Mar 08 19:13:39.555622 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 17/42] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:39 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1272 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:39.569223 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bc135bf5-fe7a-41be-aba2-cdf1fc105d50 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f439135a940>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:39.629670 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-bc135bf5-fe7a-41be-aba2-cdf1fc105d50 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] HTTP exception thrown: Snapshot 53b13558-3851-47d7-b756-6df827275b3a could not be found. Mar 08 19:13:39.630481 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bc135bf5-fe7a-41be-aba2-cdf1fc105d50 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Returning 404 to user: Snapshot 53b13558-3851-47d7-b756-6df827275b3a could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:39.631788 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bc135bf5-fe7a-41be-aba2-cdf1fc105d50 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a" status: 404 len: 111 microversion: 2.1 time: 0.075145 Mar 08 19:13:39.641403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 18/43] 10.222.0.75 () {58 vars in 1250 bytes} [Tue Mar 8 19:13:39 2022] GET /compute/v2.1/os-snapshots/53b13558-3851-47d7-b756-6df827275b3a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:13:39.646500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8e8bb135-d9f0-415f-9877-36f36fa2f7e4 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f439134e820>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:40.431604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8e8bb135-d9f0-415f-9877-36f36fa2f7e4 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee" status: 202 len: 0 microversion: 2.1 time: 0.788862 Mar 08 19:13:40.437950 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 19/44] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:13:39 2022] DELETE /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:13:40.441764 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c6632947-47d9-401f-80e4-49ed5bb6dc34 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4391cb7670>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:40.645542 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c6632947-47d9-401f-80e4-49ed5bb6dc34 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee" status: 200 len: 345 microversion: 2.1 time: 0.208270 Mar 08 19:13:40.646382 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 20/45] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:40 2022] GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee => generated 345 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:40.652990 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f43486e4-0be1-4d64-a5a0-23a013362e13 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:40.654261 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f43486e4-0be1-4d64-a5a0-23a013362e13 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:40.695288 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f43486e4-0be1-4d64-a5a0-23a013362e13 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:40.695288 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f43486e4-0be1-4d64-a5a0-23a013362e13 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:40.695288 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f43486e4-0be1-4d64-a5a0-23a013362e13 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:40.695288 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f43486e4-0be1-4d64-a5a0-23a013362e13 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:42.105127 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:13:42.105980 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:13:42.106351 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:13:42.106927 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:13:42.107588 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:13:42.122347 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:42.123137 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:42.127240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:42.128045 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:42.181914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Getting quotas for project ac3e528a3aa34615a7a87b17e74c1f34. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:42.217609 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Getting quotas for user 0fa9bfb4bd114dae8babde95970d36a3 and project ac3e528a3aa34615a7a87b17e74c1f34. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:42.227611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f43486e4-0be1-4d64-a5a0-23a013362e13 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:42.239575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:13:42.242513 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:13:42.244893 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f43486e4-0be1-4d64-a5a0-23a013362e13 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 1.596899 Mar 08 19:13:42.245963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 21/46] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:40 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:42.272437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f20db26a-f460-4daa-bbc1-ddb8e69c9939 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f439135a790>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:42.380373 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-f20db26a-f460-4daa-bbc1-ddb8e69c9939 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] HTTP exception thrown: Volume 1dabe16c-b01f-488d-9142-d38e78898fee could not be found. Mar 08 19:13:42.381346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f20db26a-f460-4daa-bbc1-ddb8e69c9939 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Returning 404 to user: Volume 1dabe16c-b01f-488d-9142-d38e78898fee could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:42.382580 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f20db26a-f460-4daa-bbc1-ddb8e69c9939 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee" status: 404 len: 109 microversion: 2.1 time: 0.135536 Mar 08 19:13:42.383248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 22/47] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:42 2022] GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:13:42.400030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-65f1cb69-1441-4caf-89e8-00242d9b1e0a tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f439134ef70>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:42.506591 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-65f1cb69-1441-4caf-89e8-00242d9b1e0a tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] HTTP exception thrown: Volume 1dabe16c-b01f-488d-9142-d38e78898fee could not be found. Mar 08 19:13:42.507480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-65f1cb69-1441-4caf-89e8-00242d9b1e0a tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Returning 404 to user: Volume 1dabe16c-b01f-488d-9142-d38e78898fee could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:42.509292 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-65f1cb69-1441-4caf-89e8-00242d9b1e0a tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee" status: 404 len: 109 microversion: 2.1 time: 0.115773 Mar 08 19:13:42.510533 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 23/48] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:13:42 2022] DELETE /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:13:42.523005 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bd6381d1-73a3-40ab-a0c4-706eee992bb3 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Calling method '.version_select at 0x7f4391cb7790>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:42.615215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-bd6381d1-73a3-40ab-a0c4-706eee992bb3 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] HTTP exception thrown: Volume 1dabe16c-b01f-488d-9142-d38e78898fee could not be found. Mar 08 19:13:42.616032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bd6381d1-73a3-40ab-a0c4-706eee992bb3 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] Returning 404 to user: Volume 1dabe16c-b01f-488d-9142-d38e78898fee could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:42.617060 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bd6381d1-73a3-40ab-a0c4-706eee992bb3 tempest-VolumesSnapshotsTestJSON-1031378879 tempest-VolumesSnapshotsTestJSON-1031378879-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee" status: 404 len: 109 microversion: 2.1 time: 0.101475 Mar 08 19:13:42.623623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 24/49] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:42 2022] GET /compute/v2.1/os-volumes/1dabe16c-b01f-488d-9142-d38e78898fee => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:13:42.633962 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e1cc9436-410e-4590-8d57-503fd02311a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.268561 Mar 08 19:13:42.647268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 26/50] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:13:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 4277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:13:42.666607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7e2e7797-5958-4522-a2bd-38b660d55a4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:42.667894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7e2e7797-5958-4522-a2bd-38b660d55a4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:42.898600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4192b3f3-96a2-468c-8784-38312df3c668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: .version_select at 0x7f4390c26940>, body: {"keypair": {"name": "tempest-keypair-1652189939"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:42.913413 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7e2e7797-5958-4522-a2bd-38b660d55a4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:42.925515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7e2e7797-5958-4522-a2bd-38b660d55a4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1222 microversion: 2.1 time: 0.272949 Mar 08 19:13:42.927608 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 25/51] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:42 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1222 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:43.048743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-4192b3f3-96a2-468c-8784-38312df3c668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:43.073176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-4192b3f3-96a2-468c-8784-38312df3c668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:43.268580 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-cbb18030-8229-4525-8d05-e1c8cbeed827 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:43.289266 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-cbb18030-8229-4525-8d05-e1c8cbeed827 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:43.346211 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cbb18030-8229-4525-8d05-e1c8cbeed827 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:43.349498 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cbb18030-8229-4525-8d05-e1c8cbeed827 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:43.366940 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cbb18030-8229-4525-8d05-e1c8cbeed827 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:43.370321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cbb18030-8229-4525-8d05-e1c8cbeed827 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:43.815567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-4192b3f3-96a2-468c-8784-38312df3c668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:43.830741 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-4192b3f3-96a2-468c-8784-38312df3c668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:43.893203 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4192b3f3-96a2-468c-8784-38312df3c668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.185388 Mar 08 19:13:43.909458 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 27/52] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:13:42 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:13:44.096489 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2046792210", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:44.303259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] validate_networks() for [('57635741-7850-4fb8-8caf-3cc49a276e9c', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:13:45.806822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-cbb18030-8229-4525-8d05-e1c8cbeed827 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:45.820056 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-cbb18030-8229-4525-8d05-e1c8cbeed827 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 2.553829 Mar 08 19:13:45.836675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 26/53] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:43 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 2575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:46.840939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-43e179cf-a4cd-4033-a6cb-dafde48ec68f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:46.842587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-43e179cf-a4cd-4033-a6cb-dafde48ec68f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:46.850878 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43e179cf-a4cd-4033-a6cb-dafde48ec68f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:46.851664 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43e179cf-a4cd-4033-a6cb-dafde48ec68f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:46.857343 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43e179cf-a4cd-4033-a6cb-dafde48ec68f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:46.857992 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43e179cf-a4cd-4033-a6cb-dafde48ec68f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:48.359491 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-43e179cf-a4cd-4033-a6cb-dafde48ec68f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:48.363657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-43e179cf-a4cd-4033-a6cb-dafde48ec68f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 1.526574 Mar 08 19:13:48.376086 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 27/54] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:46 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:13:48.669310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:13:48.669844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:13:48.670216 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:13:48.670834 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:13:48.671338 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:13:48.693543 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:48.693543 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:48.693543 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:48.694110 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:48.758778 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Getting quotas for project ac3e528a3aa34615a7a87b17e74c1f34. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:48.776348 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Getting quotas for user 0fa9bfb4bd114dae8babde95970d36a3 and project ac3e528a3aa34615a7a87b17e74c1f34. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:48.820175 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:13:48.823157 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:13:49.016649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d2f65afc-f862-4777-addd-fc49c9fd96c4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.927499 Mar 08 19:13:49.017322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 28/55] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:13:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 4929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:13:49.034838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6ca08af4-6277-4dd8-a08c-3e36d0a4425d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:49.036336 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6ca08af4-6277-4dd8-a08c-3e36d0a4425d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:49.381640 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0b30ab80-d370-4232-96bf-b58605075ec5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:49.385484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6ca08af4-6277-4dd8-a08c-3e36d0a4425d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:49.387030 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0b30ab80-d370-4232-96bf-b58605075ec5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:49.394079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6ca08af4-6277-4dd8-a08c-3e36d0a4425d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1222 microversion: 2.1 time: 0.369281 Mar 08 19:13:49.394672 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 28/56] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:49 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1222 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:49.432132 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b30ab80-d370-4232-96bf-b58605075ec5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:49.432589 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b30ab80-d370-4232-96bf-b58605075ec5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:49.438144 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b30ab80-d370-4232-96bf-b58605075ec5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:49.439223 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b30ab80-d370-4232-96bf-b58605075ec5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:50.412581 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2afd12db-4046-41ea-8031-5a56c19e4c4d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:50.413295 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2afd12db-4046-41ea-8031-5a56c19e4c4d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:50.429266 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2afd12db-4046-41ea-8031-5a56c19e4c4d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:50.430191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2afd12db-4046-41ea-8031-5a56c19e4c4d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:50.433704 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2afd12db-4046-41ea-8031-5a56c19e4c4d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:50.434141 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2afd12db-4046-41ea-8031-5a56c19e4c4d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:50.819731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2afd12db-4046-41ea-8031-5a56c19e4c4d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:50.838049 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2afd12db-4046-41ea-8031-5a56c19e4c4d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1226 microversion: 2.1 time: 0.430584 Mar 08 19:13:50.860749 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 29/57] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:50 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1226 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:51.451012 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-371f5b06-7f96-4b08-8654-0c349c2ee290 req-d8c94a5e-7442-453d-8aa1-922af0c6985f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1764d05-9f73-4c93-99d1-6068a3927cbd", "tag": "ab1d2653-193c-4b46-89f5-5adf4d0861c9"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:51.481065 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-371f5b06-7f96-4b08-8654-0c349c2ee290 req-d8c94a5e-7442-453d-8aa1-922af0c6985f service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:51.482173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-371f5b06-7f96-4b08-8654-0c349c2ee290 req-d8c94a5e-7442-453d-8aa1-922af0c6985f service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:51.520928 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-371f5b06-7f96-4b08-8654-0c349c2ee290 req-d8c94a5e-7442-453d-8aa1-922af0c6985f service nova] Creating event network-changed:ab1d2653-193c-4b46-89f5-5adf4d0861c9 for instance b1764d05-9f73-4c93-99d1-6068a3927cbd on hv-cinder-83009 Mar 08 19:13:51.522209 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-371f5b06-7f96-4b08-8654-0c349c2ee290 req-d8c94a5e-7442-453d-8aa1-922af0c6985f service nova] Acquired lock "compute-rpcapi-router" {{(pid=117390) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 19:13:51.527312 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-742e3c65-58e8-4177-a497-53803ccecb8b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:51.537108 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-742e3c65-58e8-4177-a497-53803ccecb8b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:51.537108 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-742e3c65-58e8-4177-a497-53803ccecb8b None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:51.537108 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-742e3c65-58e8-4177-a497-53803ccecb8b None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:51.567750 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.compute.rpcapi [None req-742e3c65-58e8-4177-a497-53803ccecb8b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 19:13:51.570083 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-742e3c65-58e8-4177-a497-53803ccecb8b None None] Releasing lock "compute-rpcapi-router" {{(pid=117390) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 19:13:51.609940 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0b30ab80-d370-4232-96bf-b58605075ec5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:51.626803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0b30ab80-d370-4232-96bf-b58605075ec5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 2.242698 Mar 08 19:13:51.626803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 29/58] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:49 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 2246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:13:51.648132 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-742e3c65-58e8-4177-a497-53803ccecb8b None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.785673 Mar 08 19:13:51.648937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 30/59] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:51.670668 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2107473201", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd3ea4fe-bf1a-4952-b0bd-286510901348"}], "security_groups": [{"name": "tempest-securitygroup--288796508"}], "key_name": "tempest-keypair-1334597916", "user_data": "}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:51.940742 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ecb75319-ac86-46e2-b992-5b0ae466cbe3 tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] Action: 'create', calling method: .version_select at 0x7f4390b28820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-801615975", "metadata": {"Type": "work"}}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:52.433696 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] validate_networks() for [('cd3ea4fe-bf1a-4952-b0bd-286510901348', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:13:53.505473 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ecb75319-ac86-46e2-b992-5b0ae466cbe3 tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] 10.222.0.75 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.881667 Mar 08 19:13:53.506244 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 30/60] 10.222.0.75 () {60 vars in 1155 bytes} [Tue Mar 8 19:13:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1883 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 08 19:13:53.516467 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e1a5c22c-77bc-4b77-aa98-ee19cbb1a85a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:53.518434 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e1a5c22c-77bc-4b77-aa98-ee19cbb1a85a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:53.549055 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1a5c22c-77bc-4b77-aa98-ee19cbb1a85a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:53.551422 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1a5c22c-77bc-4b77-aa98-ee19cbb1a85a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:53.552596 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1a5c22c-77bc-4b77-aa98-ee19cbb1a85a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:53.556493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1a5c22c-77bc-4b77-aa98-ee19cbb1a85a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:53.963486 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e1a5c22c-77bc-4b77-aa98-ee19cbb1a85a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:53.977006 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e1a5c22c-77bc-4b77-aa98-ee19cbb1a85a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1280 microversion: 2.1 time: 0.469402 Mar 08 19:13:53.988287 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 31/61] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:53 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1280 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:54.000661 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-76478737", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eadbce5e-f6fa-402e-acf1-15b1deb0f309"}], "security_groups": [{"name": "tempest-securitygroup--378299635"}], "key_name": "tempest-keypair-1652189939", "user_data": "}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:54.500209 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] validate_networks() for [('eadbce5e-f6fa-402e-acf1-15b1deb0f309', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:13:55.179971 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:13:55.180493 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:13:55.180891 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:13:55.181297 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:13:55.181735 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:13:55.195882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:55.196368 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:55.197174 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:55.197611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:55.231691 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:55.307474 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for user 86324e490e1041088722ab5fc5df4e91 and project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:55.307474 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:13:55.307474 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:13:55.683844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:13:55.685228 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:13:55.686116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:13:55.687655 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:13:55.688858 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:13:55.704415 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:55.705269 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:55.712926 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:55.713731 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:55.744962 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:55.751435 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:55.766200 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:13:55.768720 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:13:55.849293 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fafc242f-c3b5-4ae3-b23b-ddcfa6117c94 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.198650 Mar 08 19:13:55.850704 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 31/62] 10.222.0.75 () {62 vars in 1187 bytes} [Tue Mar 8 19:13:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 4201 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 19:13:55.864828 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1223759465", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8a25d18-0969-475a-a1e7-ff064689da30"}], "security_groups": [{"name": "tempest-securitygroup--1799120272"}], "key_name": "tempest-keypair-1874096190", "user_data": "}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:56.025216 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e1e1d2bb-f336-459f-a8f7-5f86510375f5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.032814 Mar 08 19:13:56.028298 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 32/63] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:13:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 2039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:13:56.039292 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-69893fb7-acae-4f8a-9e0f-bb5ec35fe676 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:56.040410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-69893fb7-acae-4f8a-9e0f-bb5ec35fe676 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:56.066462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-69893fb7-acae-4f8a-9e0f-bb5ec35fe676 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:56.066462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-69893fb7-acae-4f8a-9e0f-bb5ec35fe676 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:56.066462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-69893fb7-acae-4f8a-9e0f-bb5ec35fe676 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:56.066462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-69893fb7-acae-4f8a-9e0f-bb5ec35fe676 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:56.151893 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] validate_networks() for [('c8a25d18-0969-475a-a1e7-ff064689da30', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:13:56.529518 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-69893fb7-acae-4f8a-9e0f-bb5ec35fe676 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:56.550878 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-69893fb7-acae-4f8a-9e0f-bb5ec35fe676 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.519979 Mar 08 19:13:56.563745 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 33/64] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:56 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:56.570744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-93a34ef8-9bc5-492e-a769-b8518699cb7c tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] Calling method '.version_select at 0x7f4390b28d30>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:56.700491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-93a34ef8-9bc5-492e-a769-b8518699cb7c tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f" status: 200 len: 353 microversion: 2.1 time: 0.135345 Mar 08 19:13:56.701724 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 34/65] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:56 2022] GET /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f => generated 353 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:56.714707 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-79875f8c-c17d-4c15-83c6-2f4b425aa477 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:56.714707 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-79875f8c-c17d-4c15-83c6-2f4b425aa477 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:56.721922 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79875f8c-c17d-4c15-83c6-2f4b425aa477 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:56.722385 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79875f8c-c17d-4c15-83c6-2f4b425aa477 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:56.723180 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79875f8c-c17d-4c15-83c6-2f4b425aa477 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:56.723662 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79875f8c-c17d-4c15-83c6-2f4b425aa477 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:56.935112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:13:56.937096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:13:56.937306 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:13:56.937612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:13:56.938850 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:13:56.951608 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:56.954057 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:56.955730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:56.956577 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:56.981655 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for project 011362b6715747dba59bf9619c6bd65b. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:13:56.986573 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for user 3b060e4c794d46009e926c8078045d8c and project 011362b6715747dba59bf9619c6bd65b. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:13:56.999015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:13:57.002073 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:13:57.007049 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-79875f8c-c17d-4c15-83c6-2f4b425aa477 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:57.019815 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-79875f8c-c17d-4c15-83c6-2f4b425aa477 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.315000 Mar 08 19:13:57.021012 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 35/66] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:56 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:57.026415 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-86e882be-d11c-482c-89e1-925c66ac54cf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:57.027390 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-86e882be-d11c-482c-89e1-925c66ac54cf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:57.114447 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-86e882be-d11c-482c-89e1-925c66ac54cf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:57.127085 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-86e882be-d11c-482c-89e1-925c66ac54cf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:57.128761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-86e882be-d11c-482c-89e1-925c66ac54cf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:57.129971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-86e882be-d11c-482c-89e1-925c66ac54cf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1282 microversion: 2.20 time: 0.107854 Mar 08 19:13:57.132761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 36/67] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:13:57 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:13:57.135189 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6282e0d6-eae1-47fa-84f9-e77fcfd975b4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:57.135796 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6282e0d6-eae1-47fa-84f9-e77fcfd975b4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:57.192365 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6282e0d6-eae1-47fa-84f9-e77fcfd975b4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:57.199837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6282e0d6-eae1-47fa-84f9-e77fcfd975b4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1240 microversion: 2.1 time: 0.068255 Mar 08 19:13:57.204165 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 37/68] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:57 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:57.204285 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-218abd63-7d4b-49cf-a8c2-7bab5b87bc94 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.346901 Mar 08 19:13:57.204285 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 32/69] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:13:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:13:57.208640 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-1fda5082-342f-491d-aa8e-ceacbf6686ce req-38c72d3d-4b0d-428d-9f73-3b0bdd43cbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0189cf74-75db-4a6a-ae65-de5aec2f2ae2", "tag": "44706abe-99b3-4515-9c94-ae08c20efdd8"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:57.211435 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7cc37a19-0e2b-4862-a7b9-218ceba0129b tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] Calling method '.version_select at 0x7f4390295dc0>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:57.220964 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-1fda5082-342f-491d-aa8e-ceacbf6686ce req-38c72d3d-4b0d-428d-9f73-3b0bdd43cbcd service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:57.221312 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-1fda5082-342f-491d-aa8e-ceacbf6686ce req-38c72d3d-4b0d-428d-9f73-3b0bdd43cbcd service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:57.244285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-1fda5082-342f-491d-aa8e-ceacbf6686ce req-38c72d3d-4b0d-428d-9f73-3b0bdd43cbcd service nova] Creating event network-changed:44706abe-99b3-4515-9c94-ae08c20efdd8 for instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 on hv-cinder-83009 Mar 08 19:13:57.245085 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-1fda5082-342f-491d-aa8e-ceacbf6686ce req-38c72d3d-4b0d-428d-9f73-3b0bdd43cbcd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117391) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 08 19:13:57.246519 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5fa76d5-c264-4db3-ae41-1731a3e2ac06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:57.247136 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5fa76d5-c264-4db3-ae41-1731a3e2ac06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:57.248168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5fa76d5-c264-4db3-ae41-1731a3e2ac06 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:57.248763 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5fa76d5-c264-4db3-ae41-1731a3e2ac06 None None] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:57.261100 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.compute.rpcapi [None req-c5fa76d5-c264-4db3-ae41-1731a3e2ac06 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 08 19:13:57.271198 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5fa76d5-c264-4db3-ae41-1731a3e2ac06 None None] Releasing lock "compute-rpcapi-router" {{(pid=117391) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 08 19:13:57.324387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c5fa76d5-c264-4db3-ae41-1731a3e2ac06 None None] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122139 Mar 08 19:13:57.325250 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 38/70] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:57.330866 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b4c6853c-7232-40b2-8a47-8f6b56fdb44d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:57.347757 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b4c6853c-7232-40b2-8a47-8f6b56fdb44d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:57.348939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7cc37a19-0e2b-4862-a7b9-218ceba0129b tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f" status: 200 len: 353 microversion: 2.1 time: 0.146269 Mar 08 19:13:57.349876 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 33/71] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:57 2022] GET /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f => generated 353 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:57.394732 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3c8d1593-e901-4812-bc64-2689fd9e3a86 tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] Calling method '.version_select at 0x7f43902a3310>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:57.461332 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b4c6853c-7232-40b2-8a47-8f6b56fdb44d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:57.471409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b4c6853c-7232-40b2-8a47-8f6b56fdb44d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1238 microversion: 2.1 time: 0.144757 Mar 08 19:13:57.476749 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 39/72] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:57 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1238 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:57.569781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cd9a28d2-f195-4b66-a122-5d6d6d3d05cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:57.570728 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cd9a28d2-f195-4b66-a122-5d6d6d3d05cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:57.580253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd9a28d2-f195-4b66-a122-5d6d6d3d05cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:57.580253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd9a28d2-f195-4b66-a122-5d6d6d3d05cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:57.580894 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd9a28d2-f195-4b66-a122-5d6d6d3d05cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:57.581331 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd9a28d2-f195-4b66-a122-5d6d6d3d05cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:57.740225 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3c8d1593-e901-4812-bc64-2689fd9e3a86 tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] 10.222.0.75 "DELETE /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f" status: 202 len: 0 microversion: 2.1 time: 0.373067 Mar 08 19:13:57.740225 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 34/73] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:13:57 2022] DELETE /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:13:57.747772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-dabf5b0b-2936-42b9-bee8-f4ab9ced0bea tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] Calling method '.version_select at 0x7f4390295670>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:57.817760 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-dabf5b0b-2936-42b9-bee8-f4ab9ced0bea tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f" status: 200 len: 352 microversion: 2.1 time: 0.074039 Mar 08 19:13:57.818454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 35/74] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:57 2022] GET /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f => generated 352 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:13:58.134495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-84453c86-04ae-417e-8f10-346286f4f8c7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:58.134495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-84453c86-04ae-417e-8f10-346286f4f8c7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:58.134495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84453c86-04ae-417e-8f10-346286f4f8c7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:58.134495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84453c86-04ae-417e-8f10-346286f4f8c7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:58.135526 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84453c86-04ae-417e-8f10-346286f4f8c7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:58.135526 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84453c86-04ae-417e-8f10-346286f4f8c7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:58.422880 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cd9a28d2-f195-4b66-a122-5d6d6d3d05cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:58.436312 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cd9a28d2-f195-4b66-a122-5d6d6d3d05cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.870565 Mar 08 19:13:58.437879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 40/75] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:57 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:58.442872 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:58.443776 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:58.455861 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:58.455861 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:58.455861 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:58.455861 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:58.555762 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:58.566398 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:58.568446 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:58.569585 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f67149c1-522d-4076-8e24-1d6dbf0fa770 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1278 microversion: 2.20 time: 0.130506 Mar 08 19:13:58.570529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 41/76] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:13:58 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1278 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:13:58.575410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ba80660c-83e7-4988-86f2-821395ea684a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:58.576121 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ba80660c-83e7-4988-86f2-821395ea684a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:58.593458 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba80660c-83e7-4988-86f2-821395ea684a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:58.599262 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba80660c-83e7-4988-86f2-821395ea684a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:58.599262 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba80660c-83e7-4988-86f2-821395ea684a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:58.599262 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba80660c-83e7-4988-86f2-821395ea684a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:58.649369 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-84453c86-04ae-417e-8f10-346286f4f8c7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:58.658245 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-84453c86-04ae-417e-8f10-346286f4f8c7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.624692 Mar 08 19:13:58.662297 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 36/77] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:58 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:13:58.669112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-00a647ae-cbae-4426-a964-55718a5b30bc tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:58.670607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-00a647ae-cbae-4426-a964-55718a5b30bc tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:58.685828 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ba80660c-83e7-4988-86f2-821395ea684a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:58.704204 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ba80660c-83e7-4988-86f2-821395ea684a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1236 microversion: 2.1 time: 0.128095 Mar 08 19:13:58.704841 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 42/78] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:58 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1236 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:58.785296 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-00a647ae-cbae-4426-a964-55718a5b30bc tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:58.792826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-00a647ae-cbae-4426-a964-55718a5b30bc tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1238 microversion: 2.1 time: 0.129182 Mar 08 19:13:58.793928 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 37/79] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:58 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1238 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:13:58.832820 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4cb555b7-af81-45da-a50a-cd10a0a53c52 tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] Calling method '.version_select at 0x7f4390aa2310>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:58.871715 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-4cb555b7-af81-45da-a50a-cd10a0a53c52 tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] HTTP exception thrown: Volume 9d91dc6f-8dfd-4958-b0d0-74562630260f could not be found. Mar 08 19:13:58.872808 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4cb555b7-af81-45da-a50a-cd10a0a53c52 tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] Returning 404 to user: Volume 9d91dc6f-8dfd-4958-b0d0-74562630260f could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:13:58.888571 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4cb555b7-af81-45da-a50a-cd10a0a53c52 tempest-VolumesGetTestJSON-1686603836 tempest-VolumesGetTestJSON-1686603836-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f" status: 404 len: 109 microversion: 2.1 time: 0.050538 Mar 08 19:13:58.891567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 43/80] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:13:58 2022] GET /compute/v2.1/os-volumes/9d91dc6f-8dfd-4958-b0d0-74562630260f => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:13:59.292900 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-ff8a5de8-626b-4441-ab8c-6f5d64f1de26 req-49b76bca-a6e8-4045-bdfd-00fdc7d3cb80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abebaedb-474b-4500-9076-7c3f12d33513", "tag": "f5b10e88-0abd-4904-ac5c-9598e04d2762"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:13:59.308774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-ff8a5de8-626b-4441-ab8c-6f5d64f1de26 req-49b76bca-a6e8-4045-bdfd-00fdc7d3cb80 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:59.309504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-ff8a5de8-626b-4441-ab8c-6f5d64f1de26 req-49b76bca-a6e8-4045-bdfd-00fdc7d3cb80 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:59.323894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-ff8a5de8-626b-4441-ab8c-6f5d64f1de26 req-49b76bca-a6e8-4045-bdfd-00fdc7d3cb80 service nova] Creating event network-changed:f5b10e88-0abd-4904-ac5c-9598e04d2762 for instance abebaedb-474b-4500-9076-7c3f12d33513 on hv-cinder-83009 Mar 08 19:13:59.329974 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-ff8a5de8-626b-4441-ab8c-6f5d64f1de26 req-49b76bca-a6e8-4045-bdfd-00fdc7d3cb80 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125293 Mar 08 19:13:59.330623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 38/81] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:13:59.457021 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d6d343f3-0654-46c2-a214-a6abdedb5d2f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:59.457702 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d6d343f3-0654-46c2-a214-a6abdedb5d2f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:59.470901 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d6d343f3-0654-46c2-a214-a6abdedb5d2f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:59.471552 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d6d343f3-0654-46c2-a214-a6abdedb5d2f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:59.472468 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d6d343f3-0654-46c2-a214-a6abdedb5d2f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:59.472914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d6d343f3-0654-46c2-a214-a6abdedb5d2f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:59.590206 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:59.590931 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:59.599731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:59.600307 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:59.601095 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:59.601537 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:59.784327 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:59.795203 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:59.797701 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:13:59.799260 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-12ccaf93-727a-45e7-b9f3-4f30860b28e0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1342 microversion: 2.20 time: 0.213949 Mar 08 19:13:59.810382 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 39/82] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:13:59 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:13:59.821117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c186e0a6-1322-4793-9c6b-329fa9bf2d01 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:13:59.821742 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c186e0a6-1322-4793-9c6b-329fa9bf2d01 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:13:59.830990 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c186e0a6-1322-4793-9c6b-329fa9bf2d01 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:59.832004 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c186e0a6-1322-4793-9c6b-329fa9bf2d01 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:13:59.833004 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c186e0a6-1322-4793-9c6b-329fa9bf2d01 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:13:59.833604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c186e0a6-1322-4793-9c6b-329fa9bf2d01 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:00.027293 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d6d343f3-0654-46c2-a214-a6abdedb5d2f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:00.045709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d6d343f3-0654-46c2-a214-a6abdedb5d2f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.593828 Mar 08 19:14:00.057476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 44/83] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:59 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:00.068844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e1a22511-2e87-4bc0-a2bc-b4f2317eb8fb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:00.070841 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e1a22511-2e87-4bc0-a2bc-b4f2317eb8fb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:00.078758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1a22511-2e87-4bc0-a2bc-b4f2317eb8fb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:00.079657 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1a22511-2e87-4bc0-a2bc-b4f2317eb8fb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:00.081924 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1a22511-2e87-4bc0-a2bc-b4f2317eb8fb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:00.082624 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e1a22511-2e87-4bc0-a2bc-b4f2317eb8fb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:00.222926 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e1a22511-2e87-4bc0-a2bc-b4f2317eb8fb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:00.241952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e1a22511-2e87-4bc0-a2bc-b4f2317eb8fb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1300 microversion: 2.1 time: 0.182958 Mar 08 19:14:00.254165 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 45/84] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:00 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1300 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:00.261098 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-be79fd53-2564-443f-a1b3-50d1c4a41a67 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:00.262127 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-be79fd53-2564-443f-a1b3-50d1c4a41a67 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:00.271984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-be79fd53-2564-443f-a1b3-50d1c4a41a67 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:00.272835 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-be79fd53-2564-443f-a1b3-50d1c4a41a67 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:00.274599 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-be79fd53-2564-443f-a1b3-50d1c4a41a67 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:00.275167 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-be79fd53-2564-443f-a1b3-50d1c4a41a67 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:00.326675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c186e0a6-1322-4793-9c6b-329fa9bf2d01 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:00.339494 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c186e0a6-1322-4793-9c6b-329fa9bf2d01 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.527342 Mar 08 19:14:00.340813 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 40/85] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:13:59 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:00.376086 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-be79fd53-2564-443f-a1b3-50d1c4a41a67 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:00.383755 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-be79fd53-2564-443f-a1b3-50d1c4a41a67 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1290 microversion: 2.1 time: 0.128418 Mar 08 19:14:00.384558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 46/86] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:00 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1290 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:00.822004 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:00.822611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:00.829027 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:00.829478 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:00.830276 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:00.830709 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:00.894405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:00.903031 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:00.904596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:00.905900 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2e952005-2eed-438f-a449-8f865f7dbcf1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1340 microversion: 2.20 time: 0.087858 Mar 08 19:14:00.906535 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 41/87] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:00 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1340 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:01.066248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-745f62f1-eb76-4ba9-956e-77e958d7b8e3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:01.066914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-745f62f1-eb76-4ba9-956e-77e958d7b8e3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:01.074069 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-745f62f1-eb76-4ba9-956e-77e958d7b8e3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.075221 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-745f62f1-eb76-4ba9-956e-77e958d7b8e3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.077129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-745f62f1-eb76-4ba9-956e-77e958d7b8e3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.078177 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-745f62f1-eb76-4ba9-956e-77e958d7b8e3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.252910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-745f62f1-eb76-4ba9-956e-77e958d7b8e3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:01.260728 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-745f62f1-eb76-4ba9-956e-77e958d7b8e3 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.200597 Mar 08 19:14:01.261261 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 47/88] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:01 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:01.263839 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e4ddff6c-3a01-497f-a385-20920bb9e2d8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:01.264509 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e4ddff6c-3a01-497f-a385-20920bb9e2d8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:01.271144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e4ddff6c-3a01-497f-a385-20920bb9e2d8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.271532 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e4ddff6c-3a01-497f-a385-20920bb9e2d8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.272341 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e4ddff6c-3a01-497f-a385-20920bb9e2d8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.272775 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e4ddff6c-3a01-497f-a385-20920bb9e2d8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.339480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e4ddff6c-3a01-497f-a385-20920bb9e2d8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:01.349825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e4ddff6c-3a01-497f-a385-20920bb9e2d8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1298 microversion: 2.1 time: 0.090026 Mar 08 19:14:01.350441 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 42/89] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:01 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:01.356796 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-dec56403-a047-41b3-a1a4-b45c7155069f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:01.357411 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-dec56403-a047-41b3-a1a4-b45c7155069f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:01.364645 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dec56403-a047-41b3-a1a4-b45c7155069f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.365092 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dec56403-a047-41b3-a1a4-b45c7155069f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.365866 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dec56403-a047-41b3-a1a4-b45c7155069f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.366299 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dec56403-a047-41b3-a1a4-b45c7155069f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.402691 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2f10fa48-ead9-4ef7-a846-265725539cc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:01.405769 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2f10fa48-ead9-4ef7-a846-265725539cc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:01.416424 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f10fa48-ead9-4ef7-a846-265725539cc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.417525 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f10fa48-ead9-4ef7-a846-265725539cc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.419385 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f10fa48-ead9-4ef7-a846-265725539cc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.419831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f10fa48-ead9-4ef7-a846-265725539cc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.497194 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2f10fa48-ead9-4ef7-a846-265725539cc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:01.512958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2f10fa48-ead9-4ef7-a846-265725539cc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1290 microversion: 2.1 time: 0.114216 Mar 08 19:14:01.514730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 43/90] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:01 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:01.535655 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-dec56403-a047-41b3-a1a4-b45c7155069f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:01.543374 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-dec56403-a047-41b3-a1a4-b45c7155069f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.190964 Mar 08 19:14:01.544509 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 48/91] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:01 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:01.928032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:01.928127 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:01.934563 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.935043 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:01.936037 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:01.936543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.083283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:02.091531 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:02.093818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:02.094957 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e91e31d6-15d0-4fb2-80a7-fa14e3000bca tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.171554 Mar 08 19:14:02.095523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 44/92] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:01 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:02.277610 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c269d006-7d2e-44e6-9ecc-75cdd4542043 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:02.278218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c269d006-7d2e-44e6-9ecc-75cdd4542043 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:02.284766 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c269d006-7d2e-44e6-9ecc-75cdd4542043 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:02.285206 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c269d006-7d2e-44e6-9ecc-75cdd4542043 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.285975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c269d006-7d2e-44e6-9ecc-75cdd4542043 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:02.286389 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c269d006-7d2e-44e6-9ecc-75cdd4542043 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.368343 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-400a01b6-a739-403e-b827-c262e6f8d0ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:02.369017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-400a01b6-a739-403e-b827-c262e6f8d0ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:02.375203 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-400a01b6-a739-403e-b827-c262e6f8d0ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:02.375654 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-400a01b6-a739-403e-b827-c262e6f8d0ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.376455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-400a01b6-a739-403e-b827-c262e6f8d0ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:02.376892 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-400a01b6-a739-403e-b827-c262e6f8d0ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.450637 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c269d006-7d2e-44e6-9ecc-75cdd4542043 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:02.455389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-400a01b6-a739-403e-b827-c262e6f8d0ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:02.460830 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c269d006-7d2e-44e6-9ecc-75cdd4542043 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.186705 Mar 08 19:14:02.461957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 49/93] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:02 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:02.462625 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-400a01b6-a739-403e-b827-c262e6f8d0ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1298 microversion: 2.1 time: 0.098149 Mar 08 19:14:02.463196 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 45/94] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:02 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:02.531402 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ff1d9c83-5918-4d14-982d-f4953f8d0831 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:02.532374 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ff1d9c83-5918-4d14-982d-f4953f8d0831 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:02.538433 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff1d9c83-5918-4d14-982d-f4953f8d0831 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:02.538890 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff1d9c83-5918-4d14-982d-f4953f8d0831 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.539670 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff1d9c83-5918-4d14-982d-f4953f8d0831 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:02.540157 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff1d9c83-5918-4d14-982d-f4953f8d0831 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.560290 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-92aa2c4f-1b22-47c1-84b8-07223e141d73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:02.561059 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-92aa2c4f-1b22-47c1-84b8-07223e141d73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:02.567533 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-92aa2c4f-1b22-47c1-84b8-07223e141d73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:02.568237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-92aa2c4f-1b22-47c1-84b8-07223e141d73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.569201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-92aa2c4f-1b22-47c1-84b8-07223e141d73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:02.569696 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-92aa2c4f-1b22-47c1-84b8-07223e141d73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:02.604105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ff1d9c83-5918-4d14-982d-f4953f8d0831 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:02.612531 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ff1d9c83-5918-4d14-982d-f4953f8d0831 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1290 microversion: 2.1 time: 0.085448 Mar 08 19:14:02.613476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 50/95] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:02 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:02.730301 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-92aa2c4f-1b22-47c1-84b8-07223e141d73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:02.738244 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-92aa2c4f-1b22-47c1-84b8-07223e141d73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.181872 Mar 08 19:14:02.738830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 46/96] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:02 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:03.113695 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:03.114474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:03.122712 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:03.123459 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:03.125283 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:03.125768 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:03.283173 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:03.292629 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:03.294157 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:03.295260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3f7bc7b9-7fb6-47ec-886e-5bb1c7c09c41 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.186131 Mar 08 19:14:03.296335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 51/97] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:03 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:03.479585 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-31bedb7c-7fb4-4b3f-8195-32a1392522bc tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:03.480245 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-31bedb7c-7fb4-4b3f-8195-32a1392522bc tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:03.485279 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a94382e9-7447-471c-87d5-1daf9fe95f95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:03.485891 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a94382e9-7447-471c-87d5-1daf9fe95f95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:03.487135 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-31bedb7c-7fb4-4b3f-8195-32a1392522bc tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:03.487592 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-31bedb7c-7fb4-4b3f-8195-32a1392522bc tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:03.488402 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-31bedb7c-7fb4-4b3f-8195-32a1392522bc tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:03.488840 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-31bedb7c-7fb4-4b3f-8195-32a1392522bc tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:03.491618 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a94382e9-7447-471c-87d5-1daf9fe95f95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:03.492108 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a94382e9-7447-471c-87d5-1daf9fe95f95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:03.492878 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a94382e9-7447-471c-87d5-1daf9fe95f95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:03.493320 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a94382e9-7447-471c-87d5-1daf9fe95f95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:03.648807 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a94382e9-7447-471c-87d5-1daf9fe95f95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:03.657876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a94382e9-7447-471c-87d5-1daf9fe95f95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1298 microversion: 2.1 time: 0.176974 Mar 08 19:14:03.668691 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 52/98] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:03 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1298 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:03.679002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a65784cf-f091-469b-8264-c92a37b2e0d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:03.679002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a65784cf-f091-469b-8264-c92a37b2e0d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:03.681301 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a65784cf-f091-469b-8264-c92a37b2e0d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:03.681751 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a65784cf-f091-469b-8264-c92a37b2e0d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:03.682537 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a65784cf-f091-469b-8264-c92a37b2e0d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:03.682975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a65784cf-f091-469b-8264-c92a37b2e0d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:04.010721 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a65784cf-f091-469b-8264-c92a37b2e0d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:04.019398 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a65784cf-f091-469b-8264-c92a37b2e0d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1290 microversion: 2.1 time: 0.349526 Mar 08 19:14:04.019996 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 53/99] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:03 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1290 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:04.024709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-334a0014-a1a8-4390-bf95-275188a3b965 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:04.025320 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-334a0014-a1a8-4390-bf95-275188a3b965 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:04.032328 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-334a0014-a1a8-4390-bf95-275188a3b965 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:04.032782 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-334a0014-a1a8-4390-bf95-275188a3b965 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:04.033571 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-334a0014-a1a8-4390-bf95-275188a3b965 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:04.034012 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-334a0014-a1a8-4390-bf95-275188a3b965 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:04.204161 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-31bedb7c-7fb4-4b3f-8195-32a1392522bc tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:04.215123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-31bedb7c-7fb4-4b3f-8195-32a1392522bc tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.735953 Mar 08 19:14:04.215123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 47/100] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:03 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:04.317432 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:04.318395 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:04.325238 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:04.326102 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:04.327273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:04.328161 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:04.580678 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-334a0014-a1a8-4390-bf95-275188a3b965 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:04.590700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-334a0014-a1a8-4390-bf95-275188a3b965 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.568823 Mar 08 19:14:04.601250 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 54/101] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:04 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:04.681603 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0c4a3964-4a64-4350-80ed-daa4a9b8b56e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:04.682744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0c4a3964-4a64-4350-80ed-daa4a9b8b56e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:04.694791 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c4a3964-4a64-4350-80ed-daa4a9b8b56e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:04.695948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c4a3964-4a64-4350-80ed-daa4a9b8b56e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:04.697107 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c4a3964-4a64-4350-80ed-daa4a9b8b56e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:04.698073 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c4a3964-4a64-4350-80ed-daa4a9b8b56e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:04.788983 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:04.799007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:04.801604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:04.803607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-db0acee0-e1c1-48b3-bc30-3b9b00b07f8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.492662 Mar 08 19:14:04.814612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 48/102] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:04 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:04.818186 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0c4a3964-4a64-4350-80ed-daa4a9b8b56e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:04.826348 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0c4a3964-4a64-4350-80ed-daa4a9b8b56e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1298 microversion: 2.1 time: 0.152499 Mar 08 19:14:04.828823 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 55/103] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:04 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1298 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:05.037360 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8a7bae37-aa20-488e-9a34-567d2fc00cb5 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:05.038814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8a7bae37-aa20-488e-9a34-567d2fc00cb5 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:05.053301 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8a7bae37-aa20-488e-9a34-567d2fc00cb5 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.053913 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8a7bae37-aa20-488e-9a34-567d2fc00cb5 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.055162 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8a7bae37-aa20-488e-9a34-567d2fc00cb5 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.055823 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8a7bae37-aa20-488e-9a34-567d2fc00cb5 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.215013 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8a7bae37-aa20-488e-9a34-567d2fc00cb5 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:05.232876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d67ef503-5116-41f2-b355-f2158bd9ed80 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:05.240299 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d67ef503-5116-41f2-b355-f2158bd9ed80 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:05.240496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8a7bae37-aa20-488e-9a34-567d2fc00cb5 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1308 microversion: 2.1 time: 0.191950 Mar 08 19:14:05.247268 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 49/104] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:05 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:05.250126 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d67ef503-5116-41f2-b355-f2158bd9ed80 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.250920 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d67ef503-5116-41f2-b355-f2158bd9ed80 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.251743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d67ef503-5116-41f2-b355-f2158bd9ed80 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.252850 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d67ef503-5116-41f2-b355-f2158bd9ed80 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.610781 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-da4b6af9-84f1-484d-95d1-0841d236729a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:05.611396 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-da4b6af9-84f1-484d-95d1-0841d236729a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:05.624504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d67ef503-5116-41f2-b355-f2158bd9ed80 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:05.625568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da4b6af9-84f1-484d-95d1-0841d236729a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.626228 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da4b6af9-84f1-484d-95d1-0841d236729a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.628282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da4b6af9-84f1-484d-95d1-0841d236729a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.633576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da4b6af9-84f1-484d-95d1-0841d236729a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.633967 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d67ef503-5116-41f2-b355-f2158bd9ed80 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.405292 Mar 08 19:14:05.633967 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 56/105] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:05 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:05.791652 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-da4b6af9-84f1-484d-95d1-0841d236729a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:05.800427 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-da4b6af9-84f1-484d-95d1-0841d236729a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.195225 Mar 08 19:14:05.801011 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 50/106] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:05 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:05.825103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:05.825859 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:05.834104 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.835056 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.836096 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.836772 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.849031 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-367730c0-be43-4ec1-b0e1-2e9f9ea13500 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:05.849653 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-367730c0-be43-4ec1-b0e1-2e9f9ea13500 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:05.864716 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-367730c0-be43-4ec1-b0e1-2e9f9ea13500 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.865271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-367730c0-be43-4ec1-b0e1-2e9f9ea13500 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:05.867177 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-367730c0-be43-4ec1-b0e1-2e9f9ea13500 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:05.872880 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-367730c0-be43-4ec1-b0e1-2e9f9ea13500 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:06.157492 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:06.167904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-367730c0-be43-4ec1-b0e1-2e9f9ea13500 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:06.172130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:06.173801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:06.175140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e34f8e2c-5df5-4456-9465-5e0423adabaf tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.354661 Mar 08 19:14:06.175260 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-367730c0-be43-4ec1-b0e1-2e9f9ea13500 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.330278 Mar 08 19:14:06.176124 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 51/107] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:05 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:06.185174 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-15d89eb2-cd48-436d-ab99-2bb0f4d8f481 req-6f14c966-19ad-4432-afb9-7b3deaf371b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d4ea86-f489-4d6d-995e-1999c95b744d", "tag": "73344e8e-b327-42b5-a317-814f95b92074"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:06.192132 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 57/108] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:05 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:06.195774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-15d89eb2-cd48-436d-ab99-2bb0f4d8f481 req-6f14c966-19ad-4432-afb9-7b3deaf371b0 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:06.196429 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-15d89eb2-cd48-436d-ab99-2bb0f4d8f481 req-6f14c966-19ad-4432-afb9-7b3deaf371b0 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:06.218893 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-15d89eb2-cd48-436d-ab99-2bb0f4d8f481 req-6f14c966-19ad-4432-afb9-7b3deaf371b0 service nova] Creating event network-changed:73344e8e-b327-42b5-a317-814f95b92074 for instance c1d4ea86-f489-4d6d-995e-1999c95b744d on hv-cinder-83009 Mar 08 19:14:06.227647 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-15d89eb2-cd48-436d-ab99-2bb0f4d8f481 req-6f14c966-19ad-4432-afb9-7b3deaf371b0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050111 Mar 08 19:14:06.228766 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 52/109] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:06.268331 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1e3e4d58-4752-4eca-b254-51d5b70a14d8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:06.273808 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1e3e4d58-4752-4eca-b254-51d5b70a14d8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:06.279876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e3e4d58-4752-4eca-b254-51d5b70a14d8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:06.281532 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e3e4d58-4752-4eca-b254-51d5b70a14d8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:06.283016 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e3e4d58-4752-4eca-b254-51d5b70a14d8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:06.288796 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e3e4d58-4752-4eca-b254-51d5b70a14d8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:06.458099 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1e3e4d58-4752-4eca-b254-51d5b70a14d8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:06.466454 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1e3e4d58-4752-4eca-b254-51d5b70a14d8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.214198 Mar 08 19:14:06.467012 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 58/110] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:06 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:06.650451 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6657cae4-0240-4c2b-a14b-fa6abf4a491f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:06.651134 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6657cae4-0240-4c2b-a14b-fa6abf4a491f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:06.657293 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6657cae4-0240-4c2b-a14b-fa6abf4a491f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:06.657736 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6657cae4-0240-4c2b-a14b-fa6abf4a491f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:06.658494 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6657cae4-0240-4c2b-a14b-fa6abf4a491f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:06.658923 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6657cae4-0240-4c2b-a14b-fa6abf4a491f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:06.818979 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-942b4b55-601a-4c27-9c73-63d0f68106e0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:06.820510 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-942b4b55-601a-4c27-9c73-63d0f68106e0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:06.827782 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-942b4b55-601a-4c27-9c73-63d0f68106e0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:06.828628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-942b4b55-601a-4c27-9c73-63d0f68106e0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:06.829260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-942b4b55-601a-4c27-9c73-63d0f68106e0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:06.829826 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-942b4b55-601a-4c27-9c73-63d0f68106e0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:06.845811 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6657cae4-0240-4c2b-a14b-fa6abf4a491f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:06.853699 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6657cae4-0240-4c2b-a14b-fa6abf4a491f tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.207557 Mar 08 19:14:06.857820 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 53/111] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:06 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:06.991882 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-942b4b55-601a-4c27-9c73-63d0f68106e0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:06.999713 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-942b4b55-601a-4c27-9c73-63d0f68106e0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.184657 Mar 08 19:14:07.000342 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 59/112] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:06 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:07.198555 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1b4f6727-b490-43ed-a114-70a97999a78e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:07.199224 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1b4f6727-b490-43ed-a114-70a97999a78e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:07.205380 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1b4f6727-b490-43ed-a114-70a97999a78e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:07.206153 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1b4f6727-b490-43ed-a114-70a97999a78e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:07.206926 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1b4f6727-b490-43ed-a114-70a97999a78e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:07.207364 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1b4f6727-b490-43ed-a114-70a97999a78e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:07.210886 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:07.211526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:07.217357 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:07.217853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:07.218627 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:07.219060 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:07.436713 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1b4f6727-b490-43ed-a114-70a97999a78e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:07.444644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:07.444831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1b4f6727-b490-43ed-a114-70a97999a78e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.249877 Mar 08 19:14:07.445574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 54/113] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:07 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:07.461184 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:07.463956 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:07.464691 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a37d6f05-3c31-4329-98bd-23c32c8ba5d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.257941 Mar 08 19:14:07.465253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 60/114] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:07 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:14:07.486254 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c77f3b86-c099-4a2a-9be7-f9917a25f003 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:07.486874 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c77f3b86-c099-4a2a-9be7-f9917a25f003 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:07.498574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c77f3b86-c099-4a2a-9be7-f9917a25f003 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:07.498574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c77f3b86-c099-4a2a-9be7-f9917a25f003 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:07.498574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c77f3b86-c099-4a2a-9be7-f9917a25f003 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:07.498574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c77f3b86-c099-4a2a-9be7-f9917a25f003 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:07.645855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c77f3b86-c099-4a2a-9be7-f9917a25f003 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:07.653363 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c77f3b86-c099-4a2a-9be7-f9917a25f003 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.172372 Mar 08 19:14:07.653931 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 55/115] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:07 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:07.870755 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6af2fa07-0c62-4cbe-a2e0-11193b9c9bd9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:07.871365 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6af2fa07-0c62-4cbe-a2e0-11193b9c9bd9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:07.877643 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6af2fa07-0c62-4cbe-a2e0-11193b9c9bd9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:07.878093 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6af2fa07-0c62-4cbe-a2e0-11193b9c9bd9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:07.878868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6af2fa07-0c62-4cbe-a2e0-11193b9c9bd9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:07.879309 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6af2fa07-0c62-4cbe-a2e0-11193b9c9bd9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.018547 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-181ea057-01e3-48a2-8a81-5e0233957a9f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:08.019217 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-181ea057-01e3-48a2-8a81-5e0233957a9f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:08.026115 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-181ea057-01e3-48a2-8a81-5e0233957a9f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:08.026894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-181ea057-01e3-48a2-8a81-5e0233957a9f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.027662 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6af2fa07-0c62-4cbe-a2e0-11193b9c9bd9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:08.027838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-181ea057-01e3-48a2-8a81-5e0233957a9f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:08.031570 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-181ea057-01e3-48a2-8a81-5e0233957a9f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.036046 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6af2fa07-0c62-4cbe-a2e0-11193b9c9bd9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.169041 Mar 08 19:14:08.036668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 61/116] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:07 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:08.184462 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-181ea057-01e3-48a2-8a81-5e0233957a9f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:08.194492 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-181ea057-01e3-48a2-8a81-5e0233957a9f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.181466 Mar 08 19:14:08.196301 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 56/117] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:08 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:08.461910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-93601754-e665-4cba-a79c-dd7d13b075f7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:08.462524 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-93601754-e665-4cba-a79c-dd7d13b075f7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:08.468650 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93601754-e665-4cba-a79c-dd7d13b075f7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:08.469095 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93601754-e665-4cba-a79c-dd7d13b075f7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.469862 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93601754-e665-4cba-a79c-dd7d13b075f7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:08.470301 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93601754-e665-4cba-a79c-dd7d13b075f7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.484655 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:08.485348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:08.491292 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:08.491738 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.492742 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:08.493350 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.672054 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-93601754-e665-4cba-a79c-dd7d13b075f7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:08.682848 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:08.686419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-93601754-e665-4cba-a79c-dd7d13b075f7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.227668 Mar 08 19:14:08.688070 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 62/118] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:08 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:08.692881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:08.694695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:08.695831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0507011a-eeb8-4921-a4ef-50f246141079 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.216144 Mar 08 19:14:08.696407 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 57/119] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:08 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:14:08.696664 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f54cafc8-b6c2-45d0-8ded-7f8a265d321f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:08.697641 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f54cafc8-b6c2-45d0-8ded-7f8a265d321f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:08.708268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f54cafc8-b6c2-45d0-8ded-7f8a265d321f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:08.708978 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f54cafc8-b6c2-45d0-8ded-7f8a265d321f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.710173 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f54cafc8-b6c2-45d0-8ded-7f8a265d321f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:08.710872 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f54cafc8-b6c2-45d0-8ded-7f8a265d321f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:08.868241 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f54cafc8-b6c2-45d0-8ded-7f8a265d321f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:08.875750 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f54cafc8-b6c2-45d0-8ded-7f8a265d321f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.185505 Mar 08 19:14:08.876390 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 63/120] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:08 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:09.056440 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-02da0ff9-561f-459e-b5a3-621b32b6abbf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:09.057055 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-02da0ff9-561f-459e-b5a3-621b32b6abbf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:09.064316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-02da0ff9-561f-459e-b5a3-621b32b6abbf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:09.065075 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-02da0ff9-561f-459e-b5a3-621b32b6abbf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:09.066406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-02da0ff9-561f-459e-b5a3-621b32b6abbf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:09.067218 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-02da0ff9-561f-459e-b5a3-621b32b6abbf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:09.213258 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-409192fe-20d9-4453-b3be-011dd00596a9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:09.214146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-409192fe-20d9-4453-b3be-011dd00596a9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:09.222040 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-409192fe-20d9-4453-b3be-011dd00596a9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:09.222535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-409192fe-20d9-4453-b3be-011dd00596a9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:09.223474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-409192fe-20d9-4453-b3be-011dd00596a9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:09.223948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-409192fe-20d9-4453-b3be-011dd00596a9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:09.227842 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-02da0ff9-561f-459e-b5a3-621b32b6abbf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:09.235341 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-02da0ff9-561f-459e-b5a3-621b32b6abbf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.182655 Mar 08 19:14:09.235951 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 58/121] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:09 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:09.366352 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-409192fe-20d9-4453-b3be-011dd00596a9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:09.376680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-409192fe-20d9-4453-b3be-011dd00596a9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.167059 Mar 08 19:14:09.377266 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 64/122] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:09 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:09.724867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9aab0ed2-4575-4546-9d3e-574946da09d2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:09.724867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9aab0ed2-4575-4546-9d3e-574946da09d2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:09.725106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:09.725106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:09.743308 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:09.743781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:09.749921 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9aab0ed2-4575-4546-9d3e-574946da09d2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:09.750414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9aab0ed2-4575-4546-9d3e-574946da09d2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:09.751257 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9aab0ed2-4575-4546-9d3e-574946da09d2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:09.752629 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:09.753127 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:09.755787 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9aab0ed2-4575-4546-9d3e-574946da09d2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:10.549970 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9aab0ed2-4575-4546-9d3e-574946da09d2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:10.562759 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9aab0ed2-4575-4546-9d3e-574946da09d2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.859741 Mar 08 19:14:10.563454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 59/123] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:09 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:10.570150 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-992eb857-ef6d-47ed-89ac-87b2e0fec656 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:10.571577 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-992eb857-ef6d-47ed-89ac-87b2e0fec656 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:10.579513 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-992eb857-ef6d-47ed-89ac-87b2e0fec656 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:10.580387 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-992eb857-ef6d-47ed-89ac-87b2e0fec656 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:10.585178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-992eb857-ef6d-47ed-89ac-87b2e0fec656 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:10.585178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-992eb857-ef6d-47ed-89ac-87b2e0fec656 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:10.593950 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:10.608416 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:10.608416 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:10.609459 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c1018164-5386-45ea-bd3e-3d0b548738ed tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.898744 Mar 08 19:14:10.610699 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 65/124] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:09 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:10.616747 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9b41ec30-0161-49e8-9bc1-be1e0c8b2112 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:10.618708 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9b41ec30-0161-49e8-9bc1-be1e0c8b2112 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:10.631103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9b41ec30-0161-49e8-9bc1-be1e0c8b2112 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:10.631840 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9b41ec30-0161-49e8-9bc1-be1e0c8b2112 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:10.633316 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9b41ec30-0161-49e8-9bc1-be1e0c8b2112 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:10.634592 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9b41ec30-0161-49e8-9bc1-be1e0c8b2112 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.116545 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-992eb857-ef6d-47ed-89ac-87b2e0fec656 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:11.125123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-992eb857-ef6d-47ed-89ac-87b2e0fec656 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.559023 Mar 08 19:14:11.134519 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 60/125] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:10 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:11.134519 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9c92029b-6243-41d4-95b8-e195af83b1d9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:11.134519 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9c92029b-6243-41d4-95b8-e195af83b1d9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:11.138812 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9c92029b-6243-41d4-95b8-e195af83b1d9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:11.143826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9c92029b-6243-41d4-95b8-e195af83b1d9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.143826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9c92029b-6243-41d4-95b8-e195af83b1d9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:11.143826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9c92029b-6243-41d4-95b8-e195af83b1d9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.190902 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9b41ec30-0161-49e8-9bc1-be1e0c8b2112 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:11.198974 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9b41ec30-0161-49e8-9bc1-be1e0c8b2112 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.586928 Mar 08 19:14:11.200199 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 66/126] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:10 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:11.205593 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-d5c36dd2-e563-47be-9b70-7fcffbd792e7 req-a864fce3-73c5-4a41-a3f6-08c616a9a202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e431bba0-7d48-4fff-ace4-d5ba4a32a2ea", "tag": "202b6771-2b6b-4cec-a768-6c3521e9cd8f"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:11.217090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-d5c36dd2-e563-47be-9b70-7fcffbd792e7 req-a864fce3-73c5-4a41-a3f6-08c616a9a202 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:11.218159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-d5c36dd2-e563-47be-9b70-7fcffbd792e7 req-a864fce3-73c5-4a41-a3f6-08c616a9a202 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.229937 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-d5c36dd2-e563-47be-9b70-7fcffbd792e7 req-a864fce3-73c5-4a41-a3f6-08c616a9a202 service nova] Creating event network-changed:202b6771-2b6b-4cec-a768-6c3521e9cd8f for instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea on hv-cinder-83009 Mar 08 19:14:11.238819 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-d5c36dd2-e563-47be-9b70-7fcffbd792e7 req-a864fce3-73c5-4a41-a3f6-08c616a9a202 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036466 Mar 08 19:14:11.239607 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 67/127] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:11.452875 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9c92029b-6243-41d4-95b8-e195af83b1d9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:11.467156 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9c92029b-6243-41d4-95b8-e195af83b1d9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.339256 Mar 08 19:14:11.468582 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 61/128] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:11 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:11.579966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0b97f3fe-8f41-4f5d-9037-405391ecbf33 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:11.580967 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0b97f3fe-8f41-4f5d-9037-405391ecbf33 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:11.588529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b97f3fe-8f41-4f5d-9037-405391ecbf33 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:11.588529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b97f3fe-8f41-4f5d-9037-405391ecbf33 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.588529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b97f3fe-8f41-4f5d-9037-405391ecbf33 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:11.588841 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b97f3fe-8f41-4f5d-9037-405391ecbf33 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.628692 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:11.629896 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:11.635835 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:11.636554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.637589 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:11.638429 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.867646 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0b97f3fe-8f41-4f5d-9037-405391ecbf33 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:11.878647 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0b97f3fe-8f41-4f5d-9037-405391ecbf33 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.303479 Mar 08 19:14:11.881935 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 68/129] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:11 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:11.888751 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-ad09e3eb-0ee2-42d5-bd2c-6fe1e00c1080 req-9b58aa1d-d323-4781-a97c-77731670ac39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d780bbf-4e05-4ac6-8b04-8e55b2b8b873", "tag": "af2c1b42-45a5-46ce-aea2-d905ce39d3d0"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:11.902200 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ad09e3eb-0ee2-42d5-bd2c-6fe1e00c1080 req-9b58aa1d-d323-4781-a97c-77731670ac39 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:11.902912 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ad09e3eb-0ee2-42d5-bd2c-6fe1e00c1080 req-9b58aa1d-d323-4781-a97c-77731670ac39 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:11.910238 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:11.918349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:11.920443 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-ad09e3eb-0ee2-42d5-bd2c-6fe1e00c1080 req-9b58aa1d-d323-4781-a97c-77731670ac39 service nova] Creating event network-changed:af2c1b42-45a5-46ce-aea2-d905ce39d3d0 for instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 on hv-cinder-83009 Mar 08 19:14:11.921090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:11.922159 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9a7b60dd-5ac9-4a74-8caa-4cd5d6d255c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.298300 Mar 08 19:14:11.922834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 62/130] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:11 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:11.944373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-ad09e3eb-0ee2-42d5-bd2c-6fe1e00c1080 req-9b58aa1d-d323-4781-a97c-77731670ac39 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058215 Mar 08 19:14:11.944373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 69/131] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:12.146658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0d198d60-98ed-4dc9-af34-7f86a13822da tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:12.147390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0d198d60-98ed-4dc9-af34-7f86a13822da tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:12.153438 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0d198d60-98ed-4dc9-af34-7f86a13822da tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.153888 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0d198d60-98ed-4dc9-af34-7f86a13822da tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.154657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0d198d60-98ed-4dc9-af34-7f86a13822da tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.155096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0d198d60-98ed-4dc9-af34-7f86a13822da tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.219461 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-068c68b6-5e02-484f-83e3-418586e2441b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:12.220626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-068c68b6-5e02-484f-83e3-418586e2441b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:12.227633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-068c68b6-5e02-484f-83e3-418586e2441b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.228516 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-068c68b6-5e02-484f-83e3-418586e2441b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.229463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-068c68b6-5e02-484f-83e3-418586e2441b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.230078 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-068c68b6-5e02-484f-83e3-418586e2441b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.332916 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0d198d60-98ed-4dc9-af34-7f86a13822da tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:12.341010 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0d198d60-98ed-4dc9-af34-7f86a13822da tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.198123 Mar 08 19:14:12.341590 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 63/132] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:12 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:12.407600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-068c68b6-5e02-484f-83e3-418586e2441b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:12.415502 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-068c68b6-5e02-484f-83e3-418586e2441b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.201532 Mar 08 19:14:12.416130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 70/133] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:12 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:12.487244 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-62240ea4-8f6e-47ef-a27e-d86aa4c24c24 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:12.487895 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-62240ea4-8f6e-47ef-a27e-d86aa4c24c24 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:12.493839 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-62240ea4-8f6e-47ef-a27e-d86aa4c24c24 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.494296 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-62240ea4-8f6e-47ef-a27e-d86aa4c24c24 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.495063 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-62240ea4-8f6e-47ef-a27e-d86aa4c24c24 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.495502 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-62240ea4-8f6e-47ef-a27e-d86aa4c24c24 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.647695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-62240ea4-8f6e-47ef-a27e-d86aa4c24c24 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:12.656445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-62240ea4-8f6e-47ef-a27e-d86aa4c24c24 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.173512 Mar 08 19:14:12.657025 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 64/134] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:12 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:12.900668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6c405ace-c6f2-4c98-b373-60613fb3eb07 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:12.901848 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6c405ace-c6f2-4c98-b373-60613fb3eb07 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:12.908890 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c405ace-c6f2-4c98-b373-60613fb3eb07 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.909563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c405ace-c6f2-4c98-b373-60613fb3eb07 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.910634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c405ace-c6f2-4c98-b373-60613fb3eb07 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.911124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c405ace-c6f2-4c98-b373-60613fb3eb07 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.943762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:12.944578 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:12.957868 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.958398 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:12.959324 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:12.959823 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:13.177911 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6c405ace-c6f2-4c98-b373-60613fb3eb07 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:13.185716 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6c405ace-c6f2-4c98-b373-60613fb3eb07 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.289006 Mar 08 19:14:13.195568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:13.195568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:13.196308 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 71/135] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:12 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:13.196877 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:13.197990 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9944d2e6-f9f7-468d-b84d-f6c775ac9c13 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.259488 Mar 08 19:14:13.198535 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 65/136] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:12 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:14:13.357901 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f5a34ee4-d9a8-4afd-91c7-9a4d491770e1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:13.359391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f5a34ee4-d9a8-4afd-91c7-9a4d491770e1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:13.367799 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f5a34ee4-d9a8-4afd-91c7-9a4d491770e1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:13.368318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f5a34ee4-d9a8-4afd-91c7-9a4d491770e1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:13.369043 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f5a34ee4-d9a8-4afd-91c7-9a4d491770e1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:13.369478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f5a34ee4-d9a8-4afd-91c7-9a4d491770e1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:13.432860 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c4a6a874-b263-441b-8dde-0f0f399eaf2c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:13.433675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c4a6a874-b263-441b-8dde-0f0f399eaf2c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:13.440548 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4a6a874-b263-441b-8dde-0f0f399eaf2c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:13.441196 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4a6a874-b263-441b-8dde-0f0f399eaf2c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:13.441972 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4a6a874-b263-441b-8dde-0f0f399eaf2c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:13.442409 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4a6a874-b263-441b-8dde-0f0f399eaf2c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:13.616491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f5a34ee4-d9a8-4afd-91c7-9a4d491770e1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:13.625482 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f5a34ee4-d9a8-4afd-91c7-9a4d491770e1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.271077 Mar 08 19:14:13.626166 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 72/137] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:13 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:13.673877 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ec70c188-690c-488c-84a2-5835d3331824 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:13.674584 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ec70c188-690c-488c-84a2-5835d3331824 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:13.680700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ec70c188-690c-488c-84a2-5835d3331824 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:13.681205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ec70c188-690c-488c-84a2-5835d3331824 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:13.682019 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ec70c188-690c-488c-84a2-5835d3331824 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:13.682455 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ec70c188-690c-488c-84a2-5835d3331824 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:13.695280 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c4a6a874-b263-441b-8dde-0f0f399eaf2c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:13.703366 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c4a6a874-b263-441b-8dde-0f0f399eaf2c tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.274134 Mar 08 19:14:13.703964 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 66/138] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:13 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:13.818768 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ec70c188-690c-488c-84a2-5835d3331824 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:13.826036 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ec70c188-690c-488c-84a2-5835d3331824 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.156947 Mar 08 19:14:13.826598 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 73/139] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:13 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:14.203034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-54783cda-dda1-4e72-b233-b9de57caccb8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:14.203669 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-54783cda-dda1-4e72-b233-b9de57caccb8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:14.209663 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-54783cda-dda1-4e72-b233-b9de57caccb8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.210104 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-54783cda-dda1-4e72-b233-b9de57caccb8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.210866 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-54783cda-dda1-4e72-b233-b9de57caccb8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.211302 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-54783cda-dda1-4e72-b233-b9de57caccb8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.218945 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:14.220130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:14.225854 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.226302 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.227073 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.227542 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.404436 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-54783cda-dda1-4e72-b233-b9de57caccb8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:14.416649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-54783cda-dda1-4e72-b233-b9de57caccb8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.217826 Mar 08 19:14:14.417444 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 67/140] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:14 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:14.428916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:14.438268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:14.439811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:14.440964 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7eb79117-b0d4-4ae5-9db2-8ec0fc6367e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.226644 Mar 08 19:14:14.441526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 74/141] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:14 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:14.644109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0158210c-81ef-4038-8bb9-980f498e2045 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:14.644837 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0158210c-81ef-4038-8bb9-980f498e2045 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:14.650829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0158210c-81ef-4038-8bb9-980f498e2045 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.651277 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0158210c-81ef-4038-8bb9-980f498e2045 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.652071 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0158210c-81ef-4038-8bb9-980f498e2045 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.652512 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0158210c-81ef-4038-8bb9-980f498e2045 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.722688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-337602ea-2a26-47f9-8eb9-68ab8b3f59e9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:14.723620 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-337602ea-2a26-47f9-8eb9-68ab8b3f59e9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:14.729762 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-337602ea-2a26-47f9-8eb9-68ab8b3f59e9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.730244 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-337602ea-2a26-47f9-8eb9-68ab8b3f59e9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.731014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-337602ea-2a26-47f9-8eb9-68ab8b3f59e9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.731476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-337602ea-2a26-47f9-8eb9-68ab8b3f59e9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.909060 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0158210c-81ef-4038-8bb9-980f498e2045 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:14.918745 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0158210c-81ef-4038-8bb9-980f498e2045 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.279701 Mar 08 19:14:14.919320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 68/142] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:14 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:14.925910 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4d864a3b-cce1-4060-9d32-ff1f6db5190e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:14.926722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4d864a3b-cce1-4060-9d32-ff1f6db5190e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:14.939592 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d864a3b-cce1-4060-9d32-ff1f6db5190e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.940445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d864a3b-cce1-4060-9d32-ff1f6db5190e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:14.941395 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d864a3b-cce1-4060-9d32-ff1f6db5190e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:14.942589 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d864a3b-cce1-4060-9d32-ff1f6db5190e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:15.090494 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-337602ea-2a26-47f9-8eb9-68ab8b3f59e9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:15.098433 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-337602ea-2a26-47f9-8eb9-68ab8b3f59e9 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.380847 Mar 08 19:14:15.102129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 75/143] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:14 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:15.211482 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4d864a3b-cce1-4060-9d32-ff1f6db5190e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:15.220052 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4d864a3b-cce1-4060-9d32-ff1f6db5190e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.299293 Mar 08 19:14:15.220956 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 69/144] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:14 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:15.313529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-66f795dd-5772-4256-b03c-7bd7db4f36b1 req-a5a02659-8f9e-4cf0-b68a-43d87a0aa03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1764d05-9f73-4c93-99d1-6068a3927cbd", "name": "network-vif-plugged", "status": "completed", "tag": "ab1d2653-193c-4b46-89f5-5adf4d0861c9"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:15.321587 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-66f795dd-5772-4256-b03c-7bd7db4f36b1 req-a5a02659-8f9e-4cf0-b68a-43d87a0aa03a service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:15.322099 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-66f795dd-5772-4256-b03c-7bd7db4f36b1 req-a5a02659-8f9e-4cf0-b68a-43d87a0aa03a service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:15.333493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-66f795dd-5772-4256-b03c-7bd7db4f36b1 req-a5a02659-8f9e-4cf0-b68a-43d87a0aa03a service nova] Creating event network-vif-plugged:ab1d2653-193c-4b46-89f5-5adf4d0861c9 for instance b1764d05-9f73-4c93-99d1-6068a3927cbd on hv-cinder-83009 Mar 08 19:14:15.338435 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-66f795dd-5772-4256-b03c-7bd7db4f36b1 req-a5a02659-8f9e-4cf0-b68a-43d87a0aa03a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099451 Mar 08 19:14:15.339010 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 76/145] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:15.434424 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-44077e41-fad4-4fe3-8a85-3e0708f7def9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:15.434975 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-44077e41-fad4-4fe3-8a85-3e0708f7def9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:15.442435 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-44077e41-fad4-4fe3-8a85-3e0708f7def9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:15.442891 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-44077e41-fad4-4fe3-8a85-3e0708f7def9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:15.443660 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-44077e41-fad4-4fe3-8a85-3e0708f7def9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:15.444138 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-44077e41-fad4-4fe3-8a85-3e0708f7def9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:15.460081 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:15.460804 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:15.467198 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:15.467641 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:15.468844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:15.469335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:16.144542 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-44077e41-fad4-4fe3-8a85-3e0708f7def9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:16.157998 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:16.159132 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-44077e41-fad4-4fe3-8a85-3e0708f7def9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.728660 Mar 08 19:14:16.168827 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 70/146] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:15 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:16.179509 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:16.181340 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:16.182334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-12fe2192-3aac-47ec-90c2-7be25d15c6a1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.726901 Mar 08 19:14:16.182509 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-806d0cfe-3d15-4a80-838d-6424f7f736f1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:16.183050 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 77/147] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:15 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:14:16.184924 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-806d0cfe-3d15-4a80-838d-6424f7f736f1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:16.190621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f8f679a2-5fac-4fc9-ae39-cc0671becf86 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:16.191254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f8f679a2-5fac-4fc9-ae39-cc0671becf86 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:16.199808 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f8f679a2-5fac-4fc9-ae39-cc0671becf86 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:16.199971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f8f679a2-5fac-4fc9-ae39-cc0671becf86 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:16.201114 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f8f679a2-5fac-4fc9-ae39-cc0671becf86 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:16.201827 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f8f679a2-5fac-4fc9-ae39-cc0671becf86 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:16.202106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-806d0cfe-3d15-4a80-838d-6424f7f736f1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:16.203228 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-806d0cfe-3d15-4a80-838d-6424f7f736f1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:16.204147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-806d0cfe-3d15-4a80-838d-6424f7f736f1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:16.204634 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-806d0cfe-3d15-4a80-838d-6424f7f736f1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:16.676933 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f8f679a2-5fac-4fc9-ae39-cc0671becf86 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:16.684046 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-806d0cfe-3d15-4a80-838d-6424f7f736f1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:16.685567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f8f679a2-5fac-4fc9-ae39-cc0671becf86 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.501535 Mar 08 19:14:16.694899 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 78/148] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:16 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:16.694899 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5bb88a5c-39fd-426a-a21f-32b8d5db0ef9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:16.694899 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5bb88a5c-39fd-426a-a21f-32b8d5db0ef9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:16.695396 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-806d0cfe-3d15-4a80-838d-6424f7f736f1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.524885 Mar 08 19:14:16.695614 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 71/149] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:16 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:16.698674 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5bb88a5c-39fd-426a-a21f-32b8d5db0ef9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:16.699197 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5bb88a5c-39fd-426a-a21f-32b8d5db0ef9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:16.700355 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5bb88a5c-39fd-426a-a21f-32b8d5db0ef9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:16.700972 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5bb88a5c-39fd-426a-a21f-32b8d5db0ef9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:16.836418 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5bb88a5c-39fd-426a-a21f-32b8d5db0ef9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:16.844527 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5bb88a5c-39fd-426a-a21f-32b8d5db0ef9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.157257 Mar 08 19:14:16.845106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 79/150] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:16 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:17.177209 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a346f33a-41f3-4fca-8c73-8d6133d4f65d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:17.177885 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a346f33a-41f3-4fca-8c73-8d6133d4f65d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:17.184254 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a346f33a-41f3-4fca-8c73-8d6133d4f65d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.184785 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a346f33a-41f3-4fca-8c73-8d6133d4f65d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.185642 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a346f33a-41f3-4fca-8c73-8d6133d4f65d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.186811 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a346f33a-41f3-4fca-8c73-8d6133d4f65d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.201560 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:17.202756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:17.209018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.209465 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.215684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.216231 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.424046 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a346f33a-41f3-4fca-8c73-8d6133d4f65d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:17.428145 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:17.431797 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a346f33a-41f3-4fca-8c73-8d6133d4f65d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.258522 Mar 08 19:14:17.432487 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 72/151] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:17 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:17.439174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:17.441077 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:17.442542 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4ad428a0-b6b7-49e4-bdf8-ca6d4d0fc02d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.244850 Mar 08 19:14:17.443321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 80/152] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:17 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:14:17.710157 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e208b649-5b91-4b22-b6f8-82198d1fd9d5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:17.710766 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e208b649-5b91-4b22-b6f8-82198d1fd9d5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:17.714031 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8eb806f3-f693-4443-b859-734b759b7951 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:17.720272 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8eb806f3-f693-4443-b859-734b759b7951 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:17.720455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e208b649-5b91-4b22-b6f8-82198d1fd9d5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.720455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e208b649-5b91-4b22-b6f8-82198d1fd9d5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.720455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e208b649-5b91-4b22-b6f8-82198d1fd9d5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.720455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e208b649-5b91-4b22-b6f8-82198d1fd9d5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.722100 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8eb806f3-f693-4443-b859-734b759b7951 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.722632 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8eb806f3-f693-4443-b859-734b759b7951 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.723766 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8eb806f3-f693-4443-b859-734b759b7951 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.725759 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8eb806f3-f693-4443-b859-734b759b7951 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.947630 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e208b649-5b91-4b22-b6f8-82198d1fd9d5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:17.955811 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e208b649-5b91-4b22-b6f8-82198d1fd9d5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.249644 Mar 08 19:14:17.956426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 73/153] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:17 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:17.960967 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5ce42dd1-89e7-4ce2-85b8-eaf6fd8ed19f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:17.961563 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5ce42dd1-89e7-4ce2-85b8-eaf6fd8ed19f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:17.967477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5ce42dd1-89e7-4ce2-85b8-eaf6fd8ed19f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.967952 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5ce42dd1-89e7-4ce2-85b8-eaf6fd8ed19f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.968749 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5ce42dd1-89e7-4ce2-85b8-eaf6fd8ed19f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:17.969184 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5ce42dd1-89e7-4ce2-85b8-eaf6fd8ed19f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:17.970624 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8eb806f3-f693-4443-b859-734b759b7951 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:17.979250 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8eb806f3-f693-4443-b859-734b759b7951 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.269618 Mar 08 19:14:17.980023 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 81/154] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:17 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:18.102435 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5ce42dd1-89e7-4ce2-85b8-eaf6fd8ed19f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:18.110415 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5ce42dd1-89e7-4ce2-85b8-eaf6fd8ed19f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.152986 Mar 08 19:14:18.111344 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 74/155] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:17 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:18.450668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2633cb10-7b29-40a7-ba43-213303310bdf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:18.452057 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2633cb10-7b29-40a7-ba43-213303310bdf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:18.463219 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:18.463219 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:18.470600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2633cb10-7b29-40a7-ba43-213303310bdf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:18.471013 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:18.471165 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2633cb10-7b29-40a7-ba43-213303310bdf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:18.471761 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:18.471888 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2633cb10-7b29-40a7-ba43-213303310bdf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:18.472268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2633cb10-7b29-40a7-ba43-213303310bdf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:18.473087 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:18.473674 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:18.728071 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:18.732998 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2633cb10-7b29-40a7-ba43-213303310bdf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:18.745860 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2633cb10-7b29-40a7-ba43-213303310bdf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.300584 Mar 08 19:14:18.749462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 82/156] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:18 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:18.750693 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:18.753029 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:18.754664 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d9bf3f12-61b4-4ec8-ab22-6223421b53ab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.298647 Mar 08 19:14:18.755507 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 75/157] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:18 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:18.973335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-03301f6c-9bd6-4e45-9619-30be42c6a99b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:18.974205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-03301f6c-9bd6-4e45-9619-30be42c6a99b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:18.983526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-03301f6c-9bd6-4e45-9619-30be42c6a99b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:18.983526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-03301f6c-9bd6-4e45-9619-30be42c6a99b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:18.983526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-03301f6c-9bd6-4e45-9619-30be42c6a99b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:18.983526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-03301f6c-9bd6-4e45-9619-30be42c6a99b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:18.987803 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-3e2e1084-5164-4cad-98b1-bc15d2f66a9c req-ae7dcb25-8faa-4542-8666-f28e4ceb2450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0189cf74-75db-4a6a-ae65-de5aec2f2ae2", "name": "network-vif-plugged", "status": "completed", "tag": "44706abe-99b3-4515-9c94-ae08c20efdd8"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:19.002649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-3e2e1084-5164-4cad-98b1-bc15d2f66a9c req-ae7dcb25-8faa-4542-8666-f28e4ceb2450 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.011522 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-3e2e1084-5164-4cad-98b1-bc15d2f66a9c req-ae7dcb25-8faa-4542-8666-f28e4ceb2450 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:19.026704 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-3e2e1084-5164-4cad-98b1-bc15d2f66a9c req-ae7dcb25-8faa-4542-8666-f28e4ceb2450 service nova] Creating event network-vif-plugged:44706abe-99b3-4515-9c94-ae08c20efdd8 for instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 on hv-cinder-83009 Mar 08 19:14:19.033364 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-3e2e1084-5164-4cad-98b1-bc15d2f66a9c req-ae7dcb25-8faa-4542-8666-f28e4ceb2450 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050020 Mar 08 19:14:19.034272 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 76/158] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:14:19.040405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d15fac15-82de-4e4a-80ae-cccad6f530a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:19.040405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d15fac15-82de-4e4a-80ae-cccad6f530a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:19.047628 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d15fac15-82de-4e4a-80ae-cccad6f530a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.048097 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d15fac15-82de-4e4a-80ae-cccad6f530a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:19.048876 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d15fac15-82de-4e4a-80ae-cccad6f530a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.049313 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d15fac15-82de-4e4a-80ae-cccad6f530a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:19.179260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-03301f6c-9bd6-4e45-9619-30be42c6a99b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:19.187306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-03301f6c-9bd6-4e45-9619-30be42c6a99b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1314 microversion: 2.1 time: 0.218407 Mar 08 19:14:19.187882 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 83/159] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:18 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:19.200653 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-39f4f175-81f4-41f1-9ea4-c61d1f040fd8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:19.200653 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-39f4f175-81f4-41f1-9ea4-c61d1f040fd8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:19.206186 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-39f4f175-81f4-41f1-9ea4-c61d1f040fd8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.206891 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-39f4f175-81f4-41f1-9ea4-c61d1f040fd8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:19.207906 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-39f4f175-81f4-41f1-9ea4-c61d1f040fd8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.208553 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-39f4f175-81f4-41f1-9ea4-c61d1f040fd8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:19.288130 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d15fac15-82de-4e4a-80ae-cccad6f530a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:19.294222 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d15fac15-82de-4e4a-80ae-cccad6f530a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.258695 Mar 08 19:14:19.295275 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 77/160] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:19 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:19.479581 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-39f4f175-81f4-41f1-9ea4-c61d1f040fd8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:19.494424 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-39f4f175-81f4-41f1-9ea4-c61d1f040fd8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.304933 Mar 08 19:14:19.497305 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 84/161] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:19 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:19.765431 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-75c61b97-64e0-4439-ba4e-79ccb3f1fc23 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:19.766090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-75c61b97-64e0-4439-ba4e-79ccb3f1fc23 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:19.771510 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-75c61b97-64e0-4439-ba4e-79ccb3f1fc23 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.771975 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-75c61b97-64e0-4439-ba4e-79ccb3f1fc23 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:19.772729 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-75c61b97-64e0-4439-ba4e-79ccb3f1fc23 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.773153 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-75c61b97-64e0-4439-ba4e-79ccb3f1fc23 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:19.776004 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:19.776682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:19.784676 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.785307 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:19.786383 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:19.786820 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:20.004961 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-75c61b97-64e0-4439-ba4e-79ccb3f1fc23 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:20.012184 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-75c61b97-64e0-4439-ba4e-79ccb3f1fc23 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.251561 Mar 08 19:14:20.012758 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 78/162] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:19 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:20.026914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:20.035795 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:20.037300 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:20.038424 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-faa4919b-cb07-420b-b9aa-4a458d6df2e7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.267627 Mar 08 19:14:20.038924 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 85/163] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:19 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:14:20.218649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-03146647-32d6-4e13-9c39-05ce17129a97 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:20.219656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-03146647-32d6-4e13-9c39-05ce17129a97 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:20.225484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-03146647-32d6-4e13-9c39-05ce17129a97 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:20.225930 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-03146647-32d6-4e13-9c39-05ce17129a97 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:20.226687 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-03146647-32d6-4e13-9c39-05ce17129a97 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:20.227114 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-03146647-32d6-4e13-9c39-05ce17129a97 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:20.313217 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1ed231a8-be9c-47d6-992d-aafae183bb89 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:20.314079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1ed231a8-be9c-47d6-992d-aafae183bb89 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:20.320154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1ed231a8-be9c-47d6-992d-aafae183bb89 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:20.320603 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1ed231a8-be9c-47d6-992d-aafae183bb89 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:20.321377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1ed231a8-be9c-47d6-992d-aafae183bb89 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:20.321804 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1ed231a8-be9c-47d6-992d-aafae183bb89 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:20.503665 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-03146647-32d6-4e13-9c39-05ce17129a97 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:20.511197 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-03146647-32d6-4e13-9c39-05ce17129a97 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1500 microversion: 2.1 time: 0.296345 Mar 08 19:14:20.511994 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 79/164] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:20 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1500 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:20.521222 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-69804f27-44b2-4e66-8760-52ab98d9eb65 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:20.522117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-69804f27-44b2-4e66-8760-52ab98d9eb65 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:20.529084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-69804f27-44b2-4e66-8760-52ab98d9eb65 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:20.529273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-69804f27-44b2-4e66-8760-52ab98d9eb65 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:20.530239 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-69804f27-44b2-4e66-8760-52ab98d9eb65 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:20.531640 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-69804f27-44b2-4e66-8760-52ab98d9eb65 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:20.994996 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1ed231a8-be9c-47d6-992d-aafae183bb89 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:21.006387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1ed231a8-be9c-47d6-992d-aafae183bb89 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.697639 Mar 08 19:14:21.007706 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 86/165] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:20 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:21.031871 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e116e43f-c42b-41cd-a032-252720fb96bf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:21.033043 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e116e43f-c42b-41cd-a032-252720fb96bf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:21.041786 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e116e43f-c42b-41cd-a032-252720fb96bf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:21.042857 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e116e43f-c42b-41cd-a032-252720fb96bf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:21.044038 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e116e43f-c42b-41cd-a032-252720fb96bf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:21.044681 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e116e43f-c42b-41cd-a032-252720fb96bf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:21.062554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-69804f27-44b2-4e66-8760-52ab98d9eb65 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:21.070415 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-69804f27-44b2-4e66-8760-52ab98d9eb65 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.553066 Mar 08 19:14:21.085039 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 80/166] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:20 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:21.109425 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-f73576ae-309a-45e5-839a-8e921902bd2e req-ce664f80-fae1-4f87-a18d-cddf40cad639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abebaedb-474b-4500-9076-7c3f12d33513", "name": "network-vif-plugged", "status": "completed", "tag": "f5b10e88-0abd-4904-ac5c-9598e04d2762"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:21.129621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-f73576ae-309a-45e5-839a-8e921902bd2e req-ce664f80-fae1-4f87-a18d-cddf40cad639 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:21.130059 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-f73576ae-309a-45e5-839a-8e921902bd2e req-ce664f80-fae1-4f87-a18d-cddf40cad639 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:21.172858 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-f73576ae-309a-45e5-839a-8e921902bd2e req-ce664f80-fae1-4f87-a18d-cddf40cad639 service nova] Creating event network-vif-plugged:f5b10e88-0abd-4904-ac5c-9598e04d2762 for instance abebaedb-474b-4500-9076-7c3f12d33513 on hv-cinder-83009 Mar 08 19:14:21.185076 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-f73576ae-309a-45e5-839a-8e921902bd2e req-ce664f80-fae1-4f87-a18d-cddf40cad639 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094120 Mar 08 19:14:21.187958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 81/167] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:21.196981 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:21.198926 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:21.218725 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:21.221345 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:21.224815 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:21.227457 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:21.413616 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e116e43f-c42b-41cd-a032-252720fb96bf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:21.443047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e116e43f-c42b-41cd-a032-252720fb96bf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.415388 Mar 08 19:14:21.444485 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 87/168] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:21 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:21.516677 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:21.525448 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:21.528287 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:21.532660 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-481426e2-62bc-4d0a-8e1a-cd0a2d917ca2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.340187 Mar 08 19:14:21.537096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 82/169] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:21 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:22.025432 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-bedf2014-a324-465a-ab69-67747101781c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:22.026196 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-bedf2014-a324-465a-ab69-67747101781c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:22.033467 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bedf2014-a324-465a-ab69-67747101781c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.034098 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bedf2014-a324-465a-ab69-67747101781c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.034968 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bedf2014-a324-465a-ab69-67747101781c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.035467 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bedf2014-a324-465a-ab69-67747101781c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.088335 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-475ed54c-0b4e-413b-acab-962321b437fb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:22.091814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-475ed54c-0b4e-413b-acab-962321b437fb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:22.095943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-475ed54c-0b4e-413b-acab-962321b437fb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.096404 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-475ed54c-0b4e-413b-acab-962321b437fb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.097179 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-475ed54c-0b4e-413b-acab-962321b437fb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.097616 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-475ed54c-0b4e-413b-acab-962321b437fb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.347676 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bedf2014-a324-465a-ab69-67747101781c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:22.356594 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-bedf2014-a324-465a-ab69-67747101781c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.335482 Mar 08 19:14:22.357172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 88/170] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:22 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:22.402997 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-475ed54c-0b4e-413b-acab-962321b437fb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:22.411707 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-475ed54c-0b4e-413b-acab-962321b437fb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1322 microversion: 2.1 time: 0.327407 Mar 08 19:14:22.412386 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 83/171] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:22 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:22.460404 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c8463952-498b-41d3-9a33-4f1d78c65abb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:22.461129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c8463952-498b-41d3-9a33-4f1d78c65abb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:22.467289 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8463952-498b-41d3-9a33-4f1d78c65abb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.467805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8463952-498b-41d3-9a33-4f1d78c65abb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.468654 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8463952-498b-41d3-9a33-4f1d78c65abb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.469104 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8463952-498b-41d3-9a33-4f1d78c65abb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.562118 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:22.572275 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:22.572275 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.572275 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.572275 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.573574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.669101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c8463952-498b-41d3-9a33-4f1d78c65abb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:22.680047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c8463952-498b-41d3-9a33-4f1d78c65abb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.223668 Mar 08 19:14:22.681360 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 89/172] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:22 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:22.690948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c2e2c950-a563-4551-adbe-543ab9e5075d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9d2d257-0f95-464a-a9fc-3228cef88809"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:22.694000 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c2e2c950-a563-4551-adbe-543ab9e5075d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:22.704421 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c2e2c950-a563-4551-adbe-543ab9e5075d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.704888 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c2e2c950-a563-4551-adbe-543ab9e5075d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.705760 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c2e2c950-a563-4551-adbe-543ab9e5075d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:22.706362 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c2e2c950-a563-4551-adbe-543ab9e5075d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:22.766346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:22.775504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:22.777484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:22.778581 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e31a0214-8da6-469e-a839-2ce45719a646 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.221834 Mar 08 19:14:22.779328 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 84/173] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:22 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:23.375667 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1d7cd155-261b-410f-ac23-09cf8b0e029d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:23.376496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1d7cd155-261b-410f-ac23-09cf8b0e029d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:23.383627 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1d7cd155-261b-410f-ac23-09cf8b0e029d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.384263 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1d7cd155-261b-410f-ac23-09cf8b0e029d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.385244 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1d7cd155-261b-410f-ac23-09cf8b0e029d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.385803 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1d7cd155-261b-410f-ac23-09cf8b0e029d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.538894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1d7cd155-261b-410f-ac23-09cf8b0e029d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:23.547731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1d7cd155-261b-410f-ac23-09cf8b0e029d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.177174 Mar 08 19:14:23.562348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 85/174] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:23 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:23.562348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5cf6b6c8-3f04-4f45-bb6a-005109b59fc5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:23.562348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5cf6b6c8-3f04-4f45-bb6a-005109b59fc5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:23.562348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5cf6b6c8-3f04-4f45-bb6a-005109b59fc5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.562936 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5cf6b6c8-3f04-4f45-bb6a-005109b59fc5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.563022 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5cf6b6c8-3f04-4f45-bb6a-005109b59fc5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.563436 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5cf6b6c8-3f04-4f45-bb6a-005109b59fc5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.732465 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5cf6b6c8-3f04-4f45-bb6a-005109b59fc5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:23.740065 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5cf6b6c8-3f04-4f45-bb6a-005109b59fc5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1515 microversion: 2.1 time: 0.190330 Mar 08 19:14:23.746582 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 86/175] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:23 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:23.746582 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0a8e6985-23e4-4080-893e-4327e90634e7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:23.746582 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0a8e6985-23e4-4080-893e-4327e90634e7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:23.752960 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0a8e6985-23e4-4080-893e-4327e90634e7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.753390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0a8e6985-23e4-4080-893e-4327e90634e7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.754156 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0a8e6985-23e4-4080-893e-4327e90634e7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.754602 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0a8e6985-23e4-4080-893e-4327e90634e7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.774184 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c2e2c950-a563-4551-adbe-543ab9e5075d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "POST /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.091254 Mar 08 19:14:23.779190 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 90/176] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:14:22 2022] POST /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd/os-volume_attachments => generated 194 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:23.790522 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2bbf0933-8f78-4f37-8e60-b3d9c4663190 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:23.792276 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2bbf0933-8f78-4f37-8e60-b3d9c4663190 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:23.799797 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2bbf0933-8f78-4f37-8e60-b3d9c4663190 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.800410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2bbf0933-8f78-4f37-8e60-b3d9c4663190 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.801302 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2bbf0933-8f78-4f37-8e60-b3d9c4663190 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.801893 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2bbf0933-8f78-4f37-8e60-b3d9c4663190 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.829301 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-2bbf0933-8f78-4f37-8e60-b3d9c4663190 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lazy-loading 'flavor' on Instance uuid abebaedb-474b-4500-9076-7c3f12d33513 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:14:23.945279 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0a8e6985-23e4-4080-893e-4327e90634e7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:23.954171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0a8e6985-23e4-4080-893e-4327e90634e7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.212407 Mar 08 19:14:23.954935 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 87/177] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:23 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:23.960692 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:23.961299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:23.968402 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.969243 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:23.970199 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:23.970777 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:24.254531 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:24.263662 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:24.266698 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:24.267850 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-18d1f452-b787-48e9-bc9b-e84cfbc9cde9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.311807 Mar 08 19:14:24.269652 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 88/178] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:23 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:24.461401 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2bbf0933-8f78-4f37-8e60-b3d9c4663190 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513/action" status: 200 len: 32 microversion: 2.1 time: 0.675072 Mar 08 19:14:24.462176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 91/179] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:14:23 2022] POST /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513/action => generated 32 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:14:24.471560 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-422fb858-a16a-47a2-a452-76cfe82e3ee6 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:24.472728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-422fb858-a16a-47a2-a452-76cfe82e3ee6 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:24.480204 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-422fb858-a16a-47a2-a452-76cfe82e3ee6 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:24.480617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-422fb858-a16a-47a2-a452-76cfe82e3ee6 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:24.481399 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-422fb858-a16a-47a2-a452-76cfe82e3ee6 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:24.481865 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-422fb858-a16a-47a2-a452-76cfe82e3ee6 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:24.568231 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8d29c4a3-c127-4937-b98c-00d95a2b7c48 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:24.569068 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8d29c4a3-c127-4937-b98c-00d95a2b7c48 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:24.577941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d29c4a3-c127-4937-b98c-00d95a2b7c48 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:24.578404 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d29c4a3-c127-4937-b98c-00d95a2b7c48 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:24.579409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d29c4a3-c127-4937-b98c-00d95a2b7c48 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:24.579852 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d29c4a3-c127-4937-b98c-00d95a2b7c48 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:24.706961 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-422fb858-a16a-47a2-a452-76cfe82e3ee6 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:24.716735 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-422fb858-a16a-47a2-a452-76cfe82e3ee6 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.249144 Mar 08 19:14:24.723966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 89/180] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:24 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:24.850307 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8d29c4a3-c127-4937-b98c-00d95a2b7c48 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:24.863168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8d29c4a3-c127-4937-b98c-00d95a2b7c48 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.299204 Mar 08 19:14:24.864151 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 92/181] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:24 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:24.973176 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-cd185d6c-0dc4-4c09-9af5-0cbbd7d97303 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:24.973793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-cd185d6c-0dc4-4c09-9af5-0cbbd7d97303 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:24.988428 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cd185d6c-0dc4-4c09-9af5-0cbbd7d97303 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:24.990111 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cd185d6c-0dc4-4c09-9af5-0cbbd7d97303 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:24.991796 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cd185d6c-0dc4-4c09-9af5-0cbbd7d97303 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:24.992874 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cd185d6c-0dc4-4c09-9af5-0cbbd7d97303 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:25.103164 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-ae6d0d69-45ec-415b-ac07-6e615246c0ad req-64f334f7-a9d2-4661-a971-40f79e53f675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d4ea86-f489-4d6d-995e-1999c95b744d", "name": "network-vif-plugged", "status": "completed", "tag": "73344e8e-b327-42b5-a317-814f95b92074"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:25.118453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ae6d0d69-45ec-415b-ac07-6e615246c0ad req-64f334f7-a9d2-4661-a971-40f79e53f675 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:25.119410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ae6d0d69-45ec-415b-ac07-6e615246c0ad req-64f334f7-a9d2-4661-a971-40f79e53f675 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:25.141318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-ae6d0d69-45ec-415b-ac07-6e615246c0ad req-64f334f7-a9d2-4661-a971-40f79e53f675 service nova] Creating event network-vif-plugged:73344e8e-b327-42b5-a317-814f95b92074 for instance c1d4ea86-f489-4d6d-995e-1999c95b744d on hv-cinder-83009 Mar 08 19:14:25.154107 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-ae6d0d69-45ec-415b-ac07-6e615246c0ad req-64f334f7-a9d2-4661-a971-40f79e53f675 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062108 Mar 08 19:14:25.155336 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 93/182] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:14:25.289368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:25.290344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:25.293007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-cd185d6c-0dc4-4c09-9af5-0cbbd7d97303 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:25.300159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:25.300907 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:25.301972 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:25.302563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:25.305970 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-cd185d6c-0dc4-4c09-9af5-0cbbd7d97303 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.337235 Mar 08 19:14:25.314917 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 90/183] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:24 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:25.496700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:25.506058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:25.507596 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:25.508750 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9e3d11f8-b189-4011-a325-2ba1452339b5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.225920 Mar 08 19:14:25.509756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 94/184] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:25 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:14:25.740136 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-954f11b2-fd35-45f6-aab2-91bd5e94ac33 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:25.741352 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-954f11b2-fd35-45f6-aab2-91bd5e94ac33 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:25.748154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-954f11b2-fd35-45f6-aab2-91bd5e94ac33 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:25.749541 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-954f11b2-fd35-45f6-aab2-91bd5e94ac33 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:25.750493 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-954f11b2-fd35-45f6-aab2-91bd5e94ac33 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:25.750929 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-954f11b2-fd35-45f6-aab2-91bd5e94ac33 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:25.881233 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5b15417a-a4e5-438e-95d6-ac4714db3d72 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:25.882027 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5b15417a-a4e5-438e-95d6-ac4714db3d72 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:25.888906 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5b15417a-a4e5-438e-95d6-ac4714db3d72 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:25.890337 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5b15417a-a4e5-438e-95d6-ac4714db3d72 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:25.891233 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5b15417a-a4e5-438e-95d6-ac4714db3d72 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:25.891773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5b15417a-a4e5-438e-95d6-ac4714db3d72 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:25.899669 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-954f11b2-fd35-45f6-aab2-91bd5e94ac33 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:25.911792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-954f11b2-fd35-45f6-aab2-91bd5e94ac33 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.180448 Mar 08 19:14:25.912506 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 91/185] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:25 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:26.046635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5b15417a-a4e5-438e-95d6-ac4714db3d72 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:26.054007 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5b15417a-a4e5-438e-95d6-ac4714db3d72 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.177287 Mar 08 19:14:26.054561 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 95/186] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:25 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:26.328359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d6bd8558-c054-451f-8f2c-fa775f859a06 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:26.328897 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d6bd8558-c054-451f-8f2c-fa775f859a06 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:26.335026 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d6bd8558-c054-451f-8f2c-fa775f859a06 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:26.335504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d6bd8558-c054-451f-8f2c-fa775f859a06 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:26.336321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d6bd8558-c054-451f-8f2c-fa775f859a06 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:26.336768 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d6bd8558-c054-451f-8f2c-fa775f859a06 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:26.485455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d6bd8558-c054-451f-8f2c-fa775f859a06 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:26.492741 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d6bd8558-c054-451f-8f2c-fa775f859a06 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.168555 Mar 08 19:14:26.493303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 92/187] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:26 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:26.526715 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:26.527339 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:26.534285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:26.534733 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:26.535502 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:26.535962 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:26.672683 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:26.680629 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:26.682258 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:26.683356 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0d0b0988-b2ae-4339-bbe7-e8fe6da94072 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.160666 Mar 08 19:14:26.683910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 96/188] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:26 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:26.929935 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1512b0e8-55dd-46b3-b4c5-20842caa62ba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:26.930549 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1512b0e8-55dd-46b3-b4c5-20842caa62ba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:26.936901 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1512b0e8-55dd-46b3-b4c5-20842caa62ba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:26.937598 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1512b0e8-55dd-46b3-b4c5-20842caa62ba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:26.938327 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1512b0e8-55dd-46b3-b4c5-20842caa62ba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:26.938798 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1512b0e8-55dd-46b3-b4c5-20842caa62ba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:27.071247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3586569c-229b-4677-9b9c-8eed1cd40011 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:27.071863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3586569c-229b-4677-9b9c-8eed1cd40011 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:27.076906 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1512b0e8-55dd-46b3-b4c5-20842caa62ba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:27.083065 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3586569c-229b-4677-9b9c-8eed1cd40011 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:27.083523 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3586569c-229b-4677-9b9c-8eed1cd40011 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:27.084340 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3586569c-229b-4677-9b9c-8eed1cd40011 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:27.084442 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1512b0e8-55dd-46b3-b4c5-20842caa62ba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.158288 Mar 08 19:14:27.084783 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3586569c-229b-4677-9b9c-8eed1cd40011 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:27.085339 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 93/189] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:26 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:27.179426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-6ad406ec-8e0a-42fe-aed3-6ced72616e34 req-2934c71c-2e48-4046-ae54-d98c65247c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e431bba0-7d48-4fff-ace4-d5ba4a32a2ea", "name": "network-vif-plugged", "status": "completed", "tag": "202b6771-2b6b-4cec-a768-6c3521e9cd8f"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:27.189235 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-6ad406ec-8e0a-42fe-aed3-6ced72616e34 req-2934c71c-2e48-4046-ae54-d98c65247c9c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:27.189781 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-6ad406ec-8e0a-42fe-aed3-6ced72616e34 req-2934c71c-2e48-4046-ae54-d98c65247c9c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:27.202850 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-6ad406ec-8e0a-42fe-aed3-6ced72616e34 req-2934c71c-2e48-4046-ae54-d98c65247c9c service nova] Creating event network-vif-plugged:202b6771-2b6b-4cec-a768-6c3521e9cd8f for instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea on hv-cinder-83009 Mar 08 19:14:27.208968 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-6ad406ec-8e0a-42fe-aed3-6ced72616e34 req-2934c71c-2e48-4046-ae54-d98c65247c9c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033675 Mar 08 19:14:27.209697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 94/190] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:14:27.247242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3586569c-229b-4677-9b9c-8eed1cd40011 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:27.254616 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3586569c-229b-4677-9b9c-8eed1cd40011 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.187720 Mar 08 19:14:27.255175 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 97/191] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:27 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:27.511000 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8348c488-ee0d-4149-8155-7b37985d8cde tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:27.511740 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8348c488-ee0d-4149-8155-7b37985d8cde tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:27.518244 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8348c488-ee0d-4149-8155-7b37985d8cde tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:27.518864 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8348c488-ee0d-4149-8155-7b37985d8cde tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:27.519633 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8348c488-ee0d-4149-8155-7b37985d8cde tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:27.520096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8348c488-ee0d-4149-8155-7b37985d8cde tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:27.674315 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8348c488-ee0d-4149-8155-7b37985d8cde tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:27.681743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8348c488-ee0d-4149-8155-7b37985d8cde tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.175156 Mar 08 19:14:27.682299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 95/192] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:27 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:27.702046 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:27.702744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:27.709125 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:27.709601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:27.710372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:27.710805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:27.874353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:27.874353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:27.874600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:27.874600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b3891111-5a5a-42c1-830c-786a0d65229a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.174932 Mar 08 19:14:27.874600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 98/193] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:27 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:28.101313 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0692cb77-51f5-4dd1-98e2-8b21ed111ae3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:28.101914 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0692cb77-51f5-4dd1-98e2-8b21ed111ae3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:28.108292 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0692cb77-51f5-4dd1-98e2-8b21ed111ae3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:28.114316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0692cb77-51f5-4dd1-98e2-8b21ed111ae3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:28.114316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0692cb77-51f5-4dd1-98e2-8b21ed111ae3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:28.114316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0692cb77-51f5-4dd1-98e2-8b21ed111ae3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:28.257201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0692cb77-51f5-4dd1-98e2-8b21ed111ae3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:28.266574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0692cb77-51f5-4dd1-98e2-8b21ed111ae3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.168766 Mar 08 19:14:28.267707 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 96/194] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:28 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:28.275908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d23ada92-b429-4731-9b9c-f1e677c87d6a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:28.275908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d23ada92-b429-4731-9b9c-f1e677c87d6a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:28.281002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d23ada92-b429-4731-9b9c-f1e677c87d6a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:28.281002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d23ada92-b429-4731-9b9c-f1e677c87d6a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:28.285105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d23ada92-b429-4731-9b9c-f1e677c87d6a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:28.285105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d23ada92-b429-4731-9b9c-f1e677c87d6a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:28.432036 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d23ada92-b429-4731-9b9c-f1e677c87d6a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:28.443198 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d23ada92-b429-4731-9b9c-f1e677c87d6a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.174041 Mar 08 19:14:28.444623 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 99/195] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:28 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:28.698475 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-dace4c8c-189c-47ad-888b-13710415c7f2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:28.699073 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-dace4c8c-189c-47ad-888b-13710415c7f2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:28.705223 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dace4c8c-189c-47ad-888b-13710415c7f2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:28.705674 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dace4c8c-189c-47ad-888b-13710415c7f2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:28.706455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dace4c8c-189c-47ad-888b-13710415c7f2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:28.706892 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dace4c8c-189c-47ad-888b-13710415c7f2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:28.851199 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-dace4c8c-189c-47ad-888b-13710415c7f2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:28.860128 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-dace4c8c-189c-47ad-888b-13710415c7f2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.165295 Mar 08 19:14:28.860716 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 97/196] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:28 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:28.893528 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:28.894574 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:28.902084 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:28.902705 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:28.903690 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:28.904313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:29.059236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:29.067520 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:29.069147 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:29.070251 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a18a4644-1ea6-41c3-a082-13989f88facc tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.181748 Mar 08 19:14:29.070802 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 100/197] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:28 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:29.224583 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-7a12dd78-28ec-470f-afd4-59c09e325df2 req-4ed00dbb-9347-4702-9fa5-746193b2682c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d780bbf-4e05-4ac6-8b04-8e55b2b8b873", "name": "network-vif-plugged", "status": "completed", "tag": "af2c1b42-45a5-46ce-aea2-d905ce39d3d0"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:29.232440 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-7a12dd78-28ec-470f-afd4-59c09e325df2 req-4ed00dbb-9347-4702-9fa5-746193b2682c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:29.233154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-7a12dd78-28ec-470f-afd4-59c09e325df2 req-4ed00dbb-9347-4702-9fa5-746193b2682c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:29.243694 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-7a12dd78-28ec-470f-afd4-59c09e325df2 req-4ed00dbb-9347-4702-9fa5-746193b2682c service nova] Creating event network-vif-plugged:af2c1b42-45a5-46ce-aea2-d905ce39d3d0 for instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 on hv-cinder-83009 Mar 08 19:14:29.248984 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-7a12dd78-28ec-470f-afd4-59c09e325df2 req-4ed00dbb-9347-4702-9fa5-746193b2682c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027690 Mar 08 19:14:29.249570 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 98/198] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:29.286100 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5751dfec-9b25-4c63-a87f-56f105bf28de tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:29.286100 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5751dfec-9b25-4c63-a87f-56f105bf28de tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:29.299158 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5751dfec-9b25-4c63-a87f-56f105bf28de tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:29.299691 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5751dfec-9b25-4c63-a87f-56f105bf28de tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:29.300627 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5751dfec-9b25-4c63-a87f-56f105bf28de tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:29.301169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5751dfec-9b25-4c63-a87f-56f105bf28de tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:29.436258 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5751dfec-9b25-4c63-a87f-56f105bf28de tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:29.443586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5751dfec-9b25-4c63-a87f-56f105bf28de tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.162551 Mar 08 19:14:29.444179 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 101/199] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:29 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:29.464211 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-272f13ba-87fc-4b97-85ce-ca6aaa375747 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:29.464912 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-272f13ba-87fc-4b97-85ce-ca6aaa375747 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:29.472084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-272f13ba-87fc-4b97-85ce-ca6aaa375747 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:29.472534 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-272f13ba-87fc-4b97-85ce-ca6aaa375747 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:29.473441 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-272f13ba-87fc-4b97-85ce-ca6aaa375747 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:29.473887 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-272f13ba-87fc-4b97-85ce-ca6aaa375747 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:29.634909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-272f13ba-87fc-4b97-85ce-ca6aaa375747 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:29.650679 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-272f13ba-87fc-4b97-85ce-ca6aaa375747 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.190669 Mar 08 19:14:29.651252 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 99/200] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:29 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:29.876601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ed153e95-526c-4d20-8d40-a68d80dec410 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:29.877222 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ed153e95-526c-4d20-8d40-a68d80dec410 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:29.883135 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ed153e95-526c-4d20-8d40-a68d80dec410 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:29.883581 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ed153e95-526c-4d20-8d40-a68d80dec410 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:29.884376 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ed153e95-526c-4d20-8d40-a68d80dec410 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:29.884814 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ed153e95-526c-4d20-8d40-a68d80dec410 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:30.026727 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ed153e95-526c-4d20-8d40-a68d80dec410 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:30.034521 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ed153e95-526c-4d20-8d40-a68d80dec410 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.162414 Mar 08 19:14:30.035090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 102/201] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:29 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:30.088174 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:30.088937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:30.095999 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:30.096470 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:30.097232 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:30.097664 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:30.261308 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:30.269877 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:30.271388 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:30.272520 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2dc5ba0d-73fd-41dc-9774-7eee537394c2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.188315 Mar 08 19:14:30.273074 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 100/202] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:30 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:14:30.460758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-46c8fddc-8ac0-4f82-ba39-c3ab5f09b78e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:30.461371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-46c8fddc-8ac0-4f82-ba39-c3ab5f09b78e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:30.467320 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-46c8fddc-8ac0-4f82-ba39-c3ab5f09b78e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:30.467757 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-46c8fddc-8ac0-4f82-ba39-c3ab5f09b78e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:30.468550 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-46c8fddc-8ac0-4f82-ba39-c3ab5f09b78e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:30.468983 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-46c8fddc-8ac0-4f82-ba39-c3ab5f09b78e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:30.614342 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-46c8fddc-8ac0-4f82-ba39-c3ab5f09b78e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:30.621696 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-46c8fddc-8ac0-4f82-ba39-c3ab5f09b78e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.164785 Mar 08 19:14:30.622256 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 103/203] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:30 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:30.667545 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-567d61ac-0920-4f8d-a0f4-91b7f906866b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:30.668191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-567d61ac-0920-4f8d-a0f4-91b7f906866b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:30.674177 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-567d61ac-0920-4f8d-a0f4-91b7f906866b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:30.674623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-567d61ac-0920-4f8d-a0f4-91b7f906866b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:30.675382 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-567d61ac-0920-4f8d-a0f4-91b7f906866b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:30.675815 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-567d61ac-0920-4f8d-a0f4-91b7f906866b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:30.809273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-567d61ac-0920-4f8d-a0f4-91b7f906866b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:30.816633 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-567d61ac-0920-4f8d-a0f4-91b7f906866b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.152951 Mar 08 19:14:30.817199 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 101/204] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:30 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:31.052168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b1598cd3-270e-41c1-995c-bae7584c8ca1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:31.052788 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b1598cd3-270e-41c1-995c-bae7584c8ca1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:31.059192 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b1598cd3-270e-41c1-995c-bae7584c8ca1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:31.059633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b1598cd3-270e-41c1-995c-bae7584c8ca1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:31.060431 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b1598cd3-270e-41c1-995c-bae7584c8ca1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:31.061537 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b1598cd3-270e-41c1-995c-bae7584c8ca1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:31.192984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b1598cd3-270e-41c1-995c-bae7584c8ca1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:31.201202 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b1598cd3-270e-41c1-995c-bae7584c8ca1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.152823 Mar 08 19:14:31.203810 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 104/205] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:31 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:31.290778 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:31.291344 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:31.297862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:31.298308 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:31.299071 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:31.299504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:31.440668 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:31.448485 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:31.449998 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:31.451091 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6cbab824-7774-4044-8d40-d60e61cd9fc4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.164445 Mar 08 19:14:31.451673 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 102/206] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:31 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:31.640364 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-33cf7efd-7175-40a2-ae97-368282ed90ab tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:31.640986 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-33cf7efd-7175-40a2-ae97-368282ed90ab tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:31.646992 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-33cf7efd-7175-40a2-ae97-368282ed90ab tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:31.647446 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-33cf7efd-7175-40a2-ae97-368282ed90ab tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:31.648260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-33cf7efd-7175-40a2-ae97-368282ed90ab tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:31.648704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-33cf7efd-7175-40a2-ae97-368282ed90ab tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:31.800686 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-33cf7efd-7175-40a2-ae97-368282ed90ab tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:31.809390 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-33cf7efd-7175-40a2-ae97-368282ed90ab tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.174440 Mar 08 19:14:31.809967 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 105/207] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:31 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:31.833288 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3626f0ad-9b7d-4c8f-a302-5d2bebabae76 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:31.833892 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3626f0ad-9b7d-4c8f-a302-5d2bebabae76 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:31.839847 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3626f0ad-9b7d-4c8f-a302-5d2bebabae76 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:31.840319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3626f0ad-9b7d-4c8f-a302-5d2bebabae76 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:31.841102 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3626f0ad-9b7d-4c8f-a302-5d2bebabae76 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:31.841534 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3626f0ad-9b7d-4c8f-a302-5d2bebabae76 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:31.987073 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3626f0ad-9b7d-4c8f-a302-5d2bebabae76 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:31.995513 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3626f0ad-9b7d-4c8f-a302-5d2bebabae76 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.165926 Mar 08 19:14:31.996236 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 103/208] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:31 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:32.220429 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-34a0c493-37cf-4b0a-9583-d34e4410ba00 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:32.221083 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-34a0c493-37cf-4b0a-9583-d34e4410ba00 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:32.227388 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-34a0c493-37cf-4b0a-9583-d34e4410ba00 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:32.227864 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-34a0c493-37cf-4b0a-9583-d34e4410ba00 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:32.228685 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-34a0c493-37cf-4b0a-9583-d34e4410ba00 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:32.229129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-34a0c493-37cf-4b0a-9583-d34e4410ba00 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:32.377421 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-34a0c493-37cf-4b0a-9583-d34e4410ba00 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:32.385084 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-34a0c493-37cf-4b0a-9583-d34e4410ba00 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.169068 Mar 08 19:14:32.385653 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 106/209] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:32 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:32.469815 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:32.470426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:32.476409 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:32.476797 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:32.477559 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:32.477993 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:32.609503 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:32.617305 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:32.618798 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:32.619884 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5d0d2f77-a205-400f-8d59-b6ff4ed52846 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.154657 Mar 08 19:14:32.620449 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 104/210] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:32 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:32.827419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1525b8a0-135a-4f21-933c-65c918637686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:32.827965 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1525b8a0-135a-4f21-933c-65c918637686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:32.834059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1525b8a0-135a-4f21-933c-65c918637686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:32.834544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1525b8a0-135a-4f21-933c-65c918637686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:32.835321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1525b8a0-135a-4f21-933c-65c918637686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:32.835803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1525b8a0-135a-4f21-933c-65c918637686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:32.973784 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1525b8a0-135a-4f21-933c-65c918637686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:32.981493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1525b8a0-135a-4f21-933c-65c918637686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.158726 Mar 08 19:14:32.982069 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 107/211] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:32 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:33.016129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-aa40d846-0c05-49a6-a227-00ee53c49169 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:33.016737 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-aa40d846-0c05-49a6-a227-00ee53c49169 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:33.024087 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa40d846-0c05-49a6-a227-00ee53c49169 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:33.024543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa40d846-0c05-49a6-a227-00ee53c49169 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:33.027408 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa40d846-0c05-49a6-a227-00ee53c49169 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:33.030109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa40d846-0c05-49a6-a227-00ee53c49169 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:33.168527 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-aa40d846-0c05-49a6-a227-00ee53c49169 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:33.176433 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-aa40d846-0c05-49a6-a227-00ee53c49169 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.165696 Mar 08 19:14:33.176998 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 105/212] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:33 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:33.402146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-daa5c752-926b-4877-b5e6-b65df66a7e45 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:33.402760 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-daa5c752-926b-4877-b5e6-b65df66a7e45 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:33.411058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-daa5c752-926b-4877-b5e6-b65df66a7e45 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:33.411651 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-daa5c752-926b-4877-b5e6-b65df66a7e45 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:33.412744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-daa5c752-926b-4877-b5e6-b65df66a7e45 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:33.413304 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-daa5c752-926b-4877-b5e6-b65df66a7e45 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:33.561345 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-daa5c752-926b-4877-b5e6-b65df66a7e45 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:33.569225 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-daa5c752-926b-4877-b5e6-b65df66a7e45 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.170545 Mar 08 19:14:33.570325 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 108/213] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:33 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:33.638173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:33.639342 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:33.645643 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:33.646090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:33.646846 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:33.647276 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:33.790930 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:33.800114 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:33.801849 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:33.803113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e151ad8e-226b-4b89-9e8f-0b0eb9056246 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.169116 Mar 08 19:14:33.803760 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 106/214] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:33 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:33.999224 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4f61cf61-aa42-461e-a53d-cefd135ee0cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:33.999840 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4f61cf61-aa42-461e-a53d-cefd135ee0cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:34.006151 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4f61cf61-aa42-461e-a53d-cefd135ee0cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:34.006841 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4f61cf61-aa42-461e-a53d-cefd135ee0cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:34.007614 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4f61cf61-aa42-461e-a53d-cefd135ee0cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:34.008094 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4f61cf61-aa42-461e-a53d-cefd135ee0cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:34.139628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4f61cf61-aa42-461e-a53d-cefd135ee0cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:34.147012 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4f61cf61-aa42-461e-a53d-cefd135ee0cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.151866 Mar 08 19:14:34.147584 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 109/215] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:33 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:34.193108 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-07fe43b8-5d31-4148-ab4a-71fbc7e7dde1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:34.193638 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-07fe43b8-5d31-4148-ab4a-71fbc7e7dde1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:34.199724 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07fe43b8-5d31-4148-ab4a-71fbc7e7dde1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:34.200229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07fe43b8-5d31-4148-ab4a-71fbc7e7dde1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:34.201040 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07fe43b8-5d31-4148-ab4a-71fbc7e7dde1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:34.201523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07fe43b8-5d31-4148-ab4a-71fbc7e7dde1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:34.351570 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-07fe43b8-5d31-4148-ab4a-71fbc7e7dde1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:34.359625 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-07fe43b8-5d31-4148-ab4a-71fbc7e7dde1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.170378 Mar 08 19:14:34.360214 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 107/216] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:34 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:34.586589 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9667d8b0-7467-4d76-b303-da96b87917c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:34.587193 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9667d8b0-7467-4d76-b303-da96b87917c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:34.594781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9667d8b0-7467-4d76-b303-da96b87917c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:34.596880 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9667d8b0-7467-4d76-b303-da96b87917c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:34.596880 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9667d8b0-7467-4d76-b303-da96b87917c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:34.596880 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9667d8b0-7467-4d76-b303-da96b87917c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:34.788872 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9667d8b0-7467-4d76-b303-da96b87917c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:34.796171 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9667d8b0-7467-4d76-b303-da96b87917c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.213515 Mar 08 19:14:34.796736 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 110/217] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:34 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:34.822200 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:34.822805 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:34.829299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:34.829748 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:34.830513 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:34.830945 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:34.968774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:34.976656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:34.978183 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:34.979273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c59a34a1-7792-4b4a-8972-1c316ec27198 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1407 microversion: 2.20 time: 0.160913 Mar 08 19:14:34.979824 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 108/218] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:34 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:35.164466 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b00408d0-c0d5-4850-8e25-1105467ccea0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:35.165212 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b00408d0-c0d5-4850-8e25-1105467ccea0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:35.172083 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b00408d0-c0d5-4850-8e25-1105467ccea0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:35.172533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b00408d0-c0d5-4850-8e25-1105467ccea0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:35.173293 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b00408d0-c0d5-4850-8e25-1105467ccea0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:35.173723 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b00408d0-c0d5-4850-8e25-1105467ccea0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:35.304563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b00408d0-c0d5-4850-8e25-1105467ccea0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:35.312733 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b00408d0-c0d5-4850-8e25-1105467ccea0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.152110 Mar 08 19:14:35.313306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 111/219] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:35 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:35.377701 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-06ada9cc-90a9-4cb9-a57e-f69f2812e432 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:35.378334 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-06ada9cc-90a9-4cb9-a57e-f69f2812e432 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:35.385539 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-06ada9cc-90a9-4cb9-a57e-f69f2812e432 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:35.386234 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-06ada9cc-90a9-4cb9-a57e-f69f2812e432 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:35.387525 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-06ada9cc-90a9-4cb9-a57e-f69f2812e432 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:35.388572 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-06ada9cc-90a9-4cb9-a57e-f69f2812e432 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:35.538867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-06ada9cc-90a9-4cb9-a57e-f69f2812e432 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:35.546669 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-06ada9cc-90a9-4cb9-a57e-f69f2812e432 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.173334 Mar 08 19:14:35.547221 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 109/220] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:35 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:35.813951 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e4697bc3-a256-4258-8fc9-456032ecb668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:35.814749 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e4697bc3-a256-4258-8fc9-456032ecb668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:35.820962 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4697bc3-a256-4258-8fc9-456032ecb668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:35.821461 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4697bc3-a256-4258-8fc9-456032ecb668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:35.822253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4697bc3-a256-4258-8fc9-456032ecb668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:35.822712 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4697bc3-a256-4258-8fc9-456032ecb668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:35.962240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e4697bc3-a256-4258-8fc9-456032ecb668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:35.970183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e4697bc3-a256-4258-8fc9-456032ecb668 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.160138 Mar 08 19:14:35.970750 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 112/221] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:35 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:35.996905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:35.997529 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:36.003689 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.004193 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.004950 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.005380 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.141227 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:36.149524 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:36.151057 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:36.152306 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a26ae4bd-b7ff-4705-aa16-b6e07a241d91 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1599 microversion: 2.20 time: 0.159166 Mar 08 19:14:36.152874 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 110/222] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:14:35 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1599 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:14:36.171186 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-27d2c916-b45d-4204-9063-2f1c19b8d820 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:36.171705 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-27d2c916-b45d-4204-9063-2f1c19b8d820 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:36.177461 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-27d2c916-b45d-4204-9063-2f1c19b8d820 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.177898 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-27d2c916-b45d-4204-9063-2f1c19b8d820 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.178678 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-27d2c916-b45d-4204-9063-2f1c19b8d820 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.179114 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-27d2c916-b45d-4204-9063-2f1c19b8d820 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.260316 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-27d2c916-b45d-4204-9063-2f1c19b8d820 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093025 Mar 08 19:14:36.260910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 113/223] 10.222.0.75 () {60 vars in 1315 bytes} [Tue Mar 8 19:14:36 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:14:36.330399 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1ff93842-c0ee-4e9c-a04f-30f6c4be2e0c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:36.331220 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1ff93842-c0ee-4e9c-a04f-30f6c4be2e0c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:36.337444 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ff93842-c0ee-4e9c-a04f-30f6c4be2e0c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.337885 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ff93842-c0ee-4e9c-a04f-30f6c4be2e0c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.338651 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ff93842-c0ee-4e9c-a04f-30f6c4be2e0c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.339082 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ff93842-c0ee-4e9c-a04f-30f6c4be2e0c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.565128 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-82a74ff2-650a-4c4f-a74d-59f22e6de237 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:36.565654 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-82a74ff2-650a-4c4f-a74d-59f22e6de237 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:36.571596 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-82a74ff2-650a-4c4f-a74d-59f22e6de237 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.572077 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-82a74ff2-650a-4c4f-a74d-59f22e6de237 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.572850 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-82a74ff2-650a-4c4f-a74d-59f22e6de237 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.573285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-82a74ff2-650a-4c4f-a74d-59f22e6de237 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.924329 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1ff93842-c0ee-4e9c-a04f-30f6c4be2e0c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:36.933121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1ff93842-c0ee-4e9c-a04f-30f6c4be2e0c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.607199 Mar 08 19:14:36.934468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 111/224] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:36 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:36.968629 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-82a74ff2-650a-4c4f-a74d-59f22e6de237 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:36.976686 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-82a74ff2-650a-4c4f-a74d-59f22e6de237 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.416498 Mar 08 19:14:36.977270 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 114/225] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:36 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:36.987100 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4ccffa85-e351-4293-9d23-d2c1e9deb568 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:36.987711 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4ccffa85-e351-4293-9d23-d2c1e9deb568 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:36.993602 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4ccffa85-e351-4293-9d23-d2c1e9deb568 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.994043 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4ccffa85-e351-4293-9d23-d2c1e9deb568 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:36.994803 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4ccffa85-e351-4293-9d23-d2c1e9deb568 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:36.995234 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4ccffa85-e351-4293-9d23-d2c1e9deb568 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:37.462501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4ccffa85-e351-4293-9d23-d2c1e9deb568 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:37.472264 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4ccffa85-e351-4293-9d23-d2c1e9deb568 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.489539 Mar 08 19:14:37.472849 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 112/226] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:36 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:37.953875 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e574e655-ce23-4870-8bb2-c2a1a6895d7e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:37.954733 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e574e655-ce23-4870-8bb2-c2a1a6895d7e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:37.970622 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e574e655-ce23-4870-8bb2-c2a1a6895d7e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:37.971189 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e574e655-ce23-4870-8bb2-c2a1a6895d7e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:37.972126 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e574e655-ce23-4870-8bb2-c2a1a6895d7e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:37.973038 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e574e655-ce23-4870-8bb2-c2a1a6895d7e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:37.994461 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f34c9597-47f9-403a-85d5-52889b4d6b93 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:37.995363 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f34c9597-47f9-403a-85d5-52889b4d6b93 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:38.004961 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f34c9597-47f9-403a-85d5-52889b4d6b93 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:38.005410 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f34c9597-47f9-403a-85d5-52889b4d6b93 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:38.008472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f34c9597-47f9-403a-85d5-52889b4d6b93 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:38.009008 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f34c9597-47f9-403a-85d5-52889b4d6b93 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:38.211817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e574e655-ce23-4870-8bb2-c2a1a6895d7e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:38.221242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e574e655-ce23-4870-8bb2-c2a1a6895d7e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.273192 Mar 08 19:14:38.221919 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f34c9597-47f9-403a-85d5-52889b4d6b93 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:38.230342 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f34c9597-47f9-403a-85d5-52889b4d6b93 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.239896 Mar 08 19:14:38.230906 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 113/227] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:37 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:38.231319 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 115/228] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:37 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:38.236898 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-fe5d7886-2602-48c7-9970-ae90d82849bc req-12402b0d-b5fb-443d-abd1-ebb7798f3423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1d4ea86-f489-4d6d-995e-1999c95b744d", "tag": "73344e8e-b327-42b5-a317-814f95b92074"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:38.245000 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-fe5d7886-2602-48c7-9970-ae90d82849bc req-12402b0d-b5fb-443d-abd1-ebb7798f3423 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:38.245444 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-fe5d7886-2602-48c7-9970-ae90d82849bc req-12402b0d-b5fb-443d-abd1-ebb7798f3423 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:38.257881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-fe5d7886-2602-48c7-9970-ae90d82849bc req-12402b0d-b5fb-443d-abd1-ebb7798f3423 service nova] Creating event network-changed:73344e8e-b327-42b5-a317-814f95b92074 for instance c1d4ea86-f489-4d6d-995e-1999c95b744d on hv-cinder-83009 Mar 08 19:14:38.263378 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-fe5d7886-2602-48c7-9970-ae90d82849bc req-12402b0d-b5fb-443d-abd1-ebb7798f3423 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030726 Mar 08 19:14:38.264831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 114/229] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:38.489882 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-468fd777-be80-477c-a4a5-555faa3a421f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:38.490400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-468fd777-be80-477c-a4a5-555faa3a421f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:38.496322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-468fd777-be80-477c-a4a5-555faa3a421f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:38.501205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-468fd777-be80-477c-a4a5-555faa3a421f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:38.501205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-468fd777-be80-477c-a4a5-555faa3a421f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:38.501205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-468fd777-be80-477c-a4a5-555faa3a421f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:38.634505 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-468fd777-be80-477c-a4a5-555faa3a421f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:38.642655 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-468fd777-be80-477c-a4a5-555faa3a421f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.156795 Mar 08 19:14:38.643231 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 116/230] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:38 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:39.238877 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-dd39ef03-8a54-4c13-a386-c961a077a2a7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:39.239574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-dd39ef03-8a54-4c13-a386-c961a077a2a7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:39.246122 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dd39ef03-8a54-4c13-a386-c961a077a2a7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:39.246283 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-48b95065-37bc-41b7-83d5-c2576f47f14c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:39.246695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dd39ef03-8a54-4c13-a386-c961a077a2a7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:39.246811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-48b95065-37bc-41b7-83d5-c2576f47f14c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:39.247322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dd39ef03-8a54-4c13-a386-c961a077a2a7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:39.247759 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dd39ef03-8a54-4c13-a386-c961a077a2a7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:39.253316 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48b95065-37bc-41b7-83d5-c2576f47f14c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:39.253800 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48b95065-37bc-41b7-83d5-c2576f47f14c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:39.254552 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48b95065-37bc-41b7-83d5-c2576f47f14c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:39.254981 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48b95065-37bc-41b7-83d5-c2576f47f14c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:39.443713 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-48b95065-37bc-41b7-83d5-c2576f47f14c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:39.450783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-dd39ef03-8a54-4c13-a386-c961a077a2a7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:39.451783 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-48b95065-37bc-41b7-83d5-c2576f47f14c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.208624 Mar 08 19:14:39.453438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 117/231] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:39 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:39.458736 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-dd39ef03-8a54-4c13-a386-c961a077a2a7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.223917 Mar 08 19:14:39.459282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 115/232] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:39 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:39.660567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c644d356-246c-4094-9839-7efb12f7f4a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:39.661178 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c644d356-246c-4094-9839-7efb12f7f4a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:39.667086 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c644d356-246c-4094-9839-7efb12f7f4a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:39.667539 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c644d356-246c-4094-9839-7efb12f7f4a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:39.668459 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c644d356-246c-4094-9839-7efb12f7f4a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:39.668900 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c644d356-246c-4094-9839-7efb12f7f4a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:40.024112 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c644d356-246c-4094-9839-7efb12f7f4a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:40.032272 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c644d356-246c-4094-9839-7efb12f7f4a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.375628 Mar 08 19:14:40.033174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 118/233] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:39 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:40.469187 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-53d8bf81-b439-4623-8495-d5a878a6487d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:40.469937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-53d8bf81-b439-4623-8495-d5a878a6487d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:40.475017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4d279da8-2512-436e-bbdd-bc8548888a79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:40.475627 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4d279da8-2512-436e-bbdd-bc8548888a79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:40.476118 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-53d8bf81-b439-4623-8495-d5a878a6487d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:40.476830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-53d8bf81-b439-4623-8495-d5a878a6487d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:40.477317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-53d8bf81-b439-4623-8495-d5a878a6487d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:40.477745 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-53d8bf81-b439-4623-8495-d5a878a6487d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:40.482548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4d279da8-2512-436e-bbdd-bc8548888a79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:40.482548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4d279da8-2512-436e-bbdd-bc8548888a79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:40.483413 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4d279da8-2512-436e-bbdd-bc8548888a79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:40.483851 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4d279da8-2512-436e-bbdd-bc8548888a79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:40.801017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-53d8bf81-b439-4623-8495-d5a878a6487d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:40.807474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4d279da8-2512-436e-bbdd-bc8548888a79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:40.808478 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-53d8bf81-b439-4623-8495-d5a878a6487d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.343643 Mar 08 19:14:40.809054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 116/234] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:40 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:40.815873 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4d279da8-2512-436e-bbdd-bc8548888a79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.344751 Mar 08 19:14:40.825274 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 119/235] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:40 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:41.049640 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d91ea574-ce57-4358-bb0c-28e33f5f24e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:41.050247 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d91ea574-ce57-4358-bb0c-28e33f5f24e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:41.056169 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d91ea574-ce57-4358-bb0c-28e33f5f24e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:41.056621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d91ea574-ce57-4358-bb0c-28e33f5f24e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:41.057385 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d91ea574-ce57-4358-bb0c-28e33f5f24e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:41.057819 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d91ea574-ce57-4358-bb0c-28e33f5f24e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:41.196293 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d91ea574-ce57-4358-bb0c-28e33f5f24e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:41.203714 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d91ea574-ce57-4358-bb0c-28e33f5f24e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1365 microversion: 2.1 time: 0.158013 Mar 08 19:14:41.204315 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 117/236] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:41 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:41.830326 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-100e9485-9991-426b-9e41-16962f7bd97a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:41.832505 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-100e9485-9991-426b-9e41-16962f7bd97a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:41.832663 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9befd2f2-4d3b-4411-b07c-3e7797d44f1a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:41.833260 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9befd2f2-4d3b-4411-b07c-3e7797d44f1a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:41.843684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-100e9485-9991-426b-9e41-16962f7bd97a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:41.844461 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-100e9485-9991-426b-9e41-16962f7bd97a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:41.845430 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9befd2f2-4d3b-4411-b07c-3e7797d44f1a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:41.845785 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-100e9485-9991-426b-9e41-16962f7bd97a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:41.846498 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-100e9485-9991-426b-9e41-16962f7bd97a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:41.846626 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9befd2f2-4d3b-4411-b07c-3e7797d44f1a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:41.847796 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9befd2f2-4d3b-4411-b07c-3e7797d44f1a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:41.848724 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9befd2f2-4d3b-4411-b07c-3e7797d44f1a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:42.059114 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-100e9485-9991-426b-9e41-16962f7bd97a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:42.064549 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9befd2f2-4d3b-4411-b07c-3e7797d44f1a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:42.067526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-100e9485-9991-426b-9e41-16962f7bd97a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1364 microversion: 2.1 time: 0.244616 Mar 08 19:14:42.068149 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 120/237] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:41 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1364 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:42.072604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9befd2f2-4d3b-4411-b07c-3e7797d44f1a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.244131 Mar 08 19:14:42.073233 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 118/238] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:41 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:42.221337 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fa7081f9-e3e4-483a-bcde-3cfeaccdfb9a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:42.222058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fa7081f9-e3e4-483a-bcde-3cfeaccdfb9a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:42.227828 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fa7081f9-e3e4-483a-bcde-3cfeaccdfb9a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:42.228326 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fa7081f9-e3e4-483a-bcde-3cfeaccdfb9a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:42.229105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fa7081f9-e3e4-483a-bcde-3cfeaccdfb9a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:42.229544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fa7081f9-e3e4-483a-bcde-3cfeaccdfb9a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:42.369485 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fa7081f9-e3e4-483a-bcde-3cfeaccdfb9a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:42.377667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fa7081f9-e3e4-483a-bcde-3cfeaccdfb9a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1555 microversion: 2.1 time: 0.160931 Mar 08 19:14:42.378232 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 121/239] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:42 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:42.396338 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-97c904a9-d660-4025-8757-491180c3732b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:42.396821 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-97c904a9-d660-4025-8757-491180c3732b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:42.402633 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-97c904a9-d660-4025-8757-491180c3732b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:42.405117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-97c904a9-d660-4025-8757-491180c3732b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:42.405117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-97c904a9-d660-4025-8757-491180c3732b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:42.405117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-97c904a9-d660-4025-8757-491180c3732b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:42.550654 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-97c904a9-d660-4025-8757-491180c3732b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158298 Mar 08 19:14:42.551237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 119/240] 10.222.0.75 () {58 vars in 1274 bytes} [Tue Mar 8 19:14:42 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:43.092241 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6c3d731a-b826-449f-a5d2-f75ee8beb730 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:43.093782 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6c3d731a-b826-449f-a5d2-f75ee8beb730 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:43.094100 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9fa4e43d-dc10-41a1-b30d-ce38f1f9018b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:43.094912 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9fa4e43d-dc10-41a1-b30d-ce38f1f9018b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:43.101675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9fa4e43d-dc10-41a1-b30d-ce38f1f9018b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:43.102154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9fa4e43d-dc10-41a1-b30d-ce38f1f9018b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:43.102959 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c3d731a-b826-449f-a5d2-f75ee8beb730 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:43.103250 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9fa4e43d-dc10-41a1-b30d-ce38f1f9018b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:43.103676 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9fa4e43d-dc10-41a1-b30d-ce38f1f9018b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:43.104265 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c3d731a-b826-449f-a5d2-f75ee8beb730 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:43.105309 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c3d731a-b826-449f-a5d2-f75ee8beb730 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:43.106112 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c3d731a-b826-449f-a5d2-f75ee8beb730 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:43.329507 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6c3d731a-b826-449f-a5d2-f75ee8beb730 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:43.336783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9fa4e43d-dc10-41a1-b30d-ce38f1f9018b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:43.342108 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6c3d731a-b826-449f-a5d2-f75ee8beb730 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1551 microversion: 2.1 time: 0.257257 Mar 08 19:14:43.342776 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 122/241] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:43 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1551 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:43.345814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9fa4e43d-dc10-41a1-b30d-ce38f1f9018b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.256565 Mar 08 19:14:43.346552 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 120/242] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:43 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:43.360241 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-906cdd13-d5c3-4347-b7e0-a905cb278102 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:43.360765 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-906cdd13-d5c3-4347-b7e0-a905cb278102 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:43.366572 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-906cdd13-d5c3-4347-b7e0-a905cb278102 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:43.367120 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-906cdd13-d5c3-4347-b7e0-a905cb278102 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:43.367911 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-906cdd13-d5c3-4347-b7e0-a905cb278102 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:43.368385 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-906cdd13-d5c3-4347-b7e0-a905cb278102 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:43.467643 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-906cdd13-d5c3-4347-b7e0-a905cb278102 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111965 Mar 08 19:14:43.468401 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 123/243] 10.222.0.75 () {58 vars in 1274 bytes} [Tue Mar 8 19:14:43 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:44.235208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-de7aa664-d04a-403b-ba44-a99881f1eed7 req-696a0c8f-a500-4eba-85a7-1fcdb72d5217 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d780bbf-4e05-4ac6-8b04-8e55b2b8b873", "tag": "af2c1b42-45a5-46ce-aea2-d905ce39d3d0"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:44.256638 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-de7aa664-d04a-403b-ba44-a99881f1eed7 req-696a0c8f-a500-4eba-85a7-1fcdb72d5217 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:44.258834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-de7aa664-d04a-403b-ba44-a99881f1eed7 req-696a0c8f-a500-4eba-85a7-1fcdb72d5217 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:44.275664 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-de7aa664-d04a-403b-ba44-a99881f1eed7 req-696a0c8f-a500-4eba-85a7-1fcdb72d5217 service nova] Creating event network-changed:af2c1b42-45a5-46ce-aea2-d905ce39d3d0 for instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 on hv-cinder-83009 Mar 08 19:14:44.282428 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-de7aa664-d04a-403b-ba44-a99881f1eed7 req-696a0c8f-a500-4eba-85a7-1fcdb72d5217 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058575 Mar 08 19:14:44.284496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 121/244] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:44.357000 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7e9aa1ed-0d3c-4620-90c0-ab2f1ca749f6 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:44.357000 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7e9aa1ed-0d3c-4620-90c0-ab2f1ca749f6 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:44.364505 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-443b49d1-f657-4b71-8511-acb04322b443 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:44.365461 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-443b49d1-f657-4b71-8511-acb04322b443 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:44.379640 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7e9aa1ed-0d3c-4620-90c0-ab2f1ca749f6 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:44.380317 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7e9aa1ed-0d3c-4620-90c0-ab2f1ca749f6 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:44.380715 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-443b49d1-f657-4b71-8511-acb04322b443 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:44.381316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-443b49d1-f657-4b71-8511-acb04322b443 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:44.382278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7e9aa1ed-0d3c-4620-90c0-ab2f1ca749f6 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:44.383355 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-443b49d1-f657-4b71-8511-acb04322b443 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:44.383957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7e9aa1ed-0d3c-4620-90c0-ab2f1ca749f6 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:44.384527 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-443b49d1-f657-4b71-8511-acb04322b443 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:44.443417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7e9aa1ed-0d3c-4620-90c0-ab2f1ca749f6 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:14:44.769567 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-443b49d1-f657-4b71-8511-acb04322b443 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:44.778692 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-443b49d1-f657-4b71-8511-acb04322b443 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.419843 Mar 08 19:14:44.779558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 122/245] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:44 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:44.810076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7e9aa1ed-0d3c-4620-90c0-ab2f1ca749f6 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 204 len: 0 microversion: 2.1 time: 0.458421 Mar 08 19:14:44.816605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 124/246] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:14:44 2022] DELETE /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:14:44.820523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2473a4c0-19c9-486e-ba18-bfdee0af6a6b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:44.821142 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2473a4c0-19c9-486e-ba18-bfdee0af6a6b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:44.839118 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2473a4c0-19c9-486e-ba18-bfdee0af6a6b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:44.839576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2473a4c0-19c9-486e-ba18-bfdee0af6a6b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:44.840387 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2473a4c0-19c9-486e-ba18-bfdee0af6a6b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:44.840954 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2473a4c0-19c9-486e-ba18-bfdee0af6a6b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:45.172495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2473a4c0-19c9-486e-ba18-bfdee0af6a6b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:45.181841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2473a4c0-19c9-486e-ba18-bfdee0af6a6b tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1552 microversion: 2.1 time: 0.365000 Mar 08 19:14:45.182728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 123/247] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:44 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1552 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:45.619421 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-ff3bd460-bdc2-4901-86d0-04221eed000e req-21cfe8bd-dcef-46bd-ae25-2b74a6151d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e431bba0-7d48-4fff-ace4-d5ba4a32a2ea", "tag": "202b6771-2b6b-4cec-a768-6c3521e9cd8f"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:45.636283 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ff3bd460-bdc2-4901-86d0-04221eed000e req-21cfe8bd-dcef-46bd-ae25-2b74a6151d1f service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:45.636739 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ff3bd460-bdc2-4901-86d0-04221eed000e req-21cfe8bd-dcef-46bd-ae25-2b74a6151d1f service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:45.651820 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-ff3bd460-bdc2-4901-86d0-04221eed000e req-21cfe8bd-dcef-46bd-ae25-2b74a6151d1f service nova] Creating event network-changed:202b6771-2b6b-4cec-a768-6c3521e9cd8f for instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea on hv-cinder-83009 Mar 08 19:14:45.657595 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-ff3bd460-bdc2-4901-86d0-04221eed000e req-21cfe8bd-dcef-46bd-ae25-2b74a6151d1f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046167 Mar 08 19:14:45.660382 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 125/248] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:14:45.796704 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-aed9c36b-5132-4f1a-ba3e-f3ec759d3e6d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:45.797319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-aed9c36b-5132-4f1a-ba3e-f3ec759d3e6d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:45.803701 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aed9c36b-5132-4f1a-ba3e-f3ec759d3e6d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:45.804182 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aed9c36b-5132-4f1a-ba3e-f3ec759d3e6d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:45.804969 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aed9c36b-5132-4f1a-ba3e-f3ec759d3e6d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:45.805404 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aed9c36b-5132-4f1a-ba3e-f3ec759d3e6d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:45.947889 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-aed9c36b-5132-4f1a-ba3e-f3ec759d3e6d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:45.955899 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-aed9c36b-5132-4f1a-ba3e-f3ec759d3e6d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.163378 Mar 08 19:14:45.956563 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 124/249] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:45 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:46.202821 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a731a326-93ec-4305-8813-dc1aed2acfb5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:46.203646 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a731a326-93ec-4305-8813-dc1aed2acfb5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:46.209925 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a731a326-93ec-4305-8813-dc1aed2acfb5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:46.210372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a731a326-93ec-4305-8813-dc1aed2acfb5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:46.211133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a731a326-93ec-4305-8813-dc1aed2acfb5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:46.211562 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a731a326-93ec-4305-8813-dc1aed2acfb5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:46.349204 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a731a326-93ec-4305-8813-dc1aed2acfb5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:46.357730 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a731a326-93ec-4305-8813-dc1aed2acfb5 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1552 microversion: 2.1 time: 0.159225 Mar 08 19:14:46.358334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 126/250] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:46 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:46.974303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f1f64f57-8475-42b0-9ad2-93d00a114ef3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:46.974303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f1f64f57-8475-42b0-9ad2-93d00a114ef3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:46.980521 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1f64f57-8475-42b0-9ad2-93d00a114ef3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:46.980966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1f64f57-8475-42b0-9ad2-93d00a114ef3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:46.981724 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1f64f57-8475-42b0-9ad2-93d00a114ef3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:46.983178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1f64f57-8475-42b0-9ad2-93d00a114ef3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:47.131139 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f1f64f57-8475-42b0-9ad2-93d00a114ef3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:47.139522 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f1f64f57-8475-42b0-9ad2-93d00a114ef3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.169796 Mar 08 19:14:47.140113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 125/251] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:46 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:47.375303 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6b67b734-a1f7-42e0-b393-2f42d1aaa4cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:47.376167 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6b67b734-a1f7-42e0-b393-2f42d1aaa4cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:47.382916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6b67b734-a1f7-42e0-b393-2f42d1aaa4cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:47.383363 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6b67b734-a1f7-42e0-b393-2f42d1aaa4cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:47.384172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6b67b734-a1f7-42e0-b393-2f42d1aaa4cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:47.384612 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6b67b734-a1f7-42e0-b393-2f42d1aaa4cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:47.522876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6b67b734-a1f7-42e0-b393-2f42d1aaa4cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:47.535412 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6b67b734-a1f7-42e0-b393-2f42d1aaa4cf tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1552 microversion: 2.1 time: 0.164551 Mar 08 19:14:47.536062 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 127/252] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:47 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:48.155924 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f733a9b4-68e0-4cf2-8842-e19627f81073 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:48.156544 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f733a9b4-68e0-4cf2-8842-e19627f81073 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:48.162369 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f733a9b4-68e0-4cf2-8842-e19627f81073 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:48.162809 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f733a9b4-68e0-4cf2-8842-e19627f81073 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:48.163559 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f733a9b4-68e0-4cf2-8842-e19627f81073 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:48.164015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f733a9b4-68e0-4cf2-8842-e19627f81073 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:48.305814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f733a9b4-68e0-4cf2-8842-e19627f81073 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:48.313959 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f733a9b4-68e0-4cf2-8842-e19627f81073 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.161878 Mar 08 19:14:48.314514 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 126/253] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:48 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:48.555662 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-532be1c7-a022-4b7b-ba20-f3694620872e tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:48.556735 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-532be1c7-a022-4b7b-ba20-f3694620872e tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:48.567706 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-532be1c7-a022-4b7b-ba20-f3694620872e tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:48.568186 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-532be1c7-a022-4b7b-ba20-f3694620872e tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:48.568972 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-532be1c7-a022-4b7b-ba20-f3694620872e tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:48.569418 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-532be1c7-a022-4b7b-ba20-f3694620872e tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:48.721391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-532be1c7-a022-4b7b-ba20-f3694620872e tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:48.729221 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-532be1c7-a022-4b7b-ba20-f3694620872e tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1552 microversion: 2.1 time: 0.178866 Mar 08 19:14:48.729789 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 128/254] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:48 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:49.330706 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c3637ad1-26f5-4b35-9551-2ba0be26d27b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:49.331351 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c3637ad1-26f5-4b35-9551-2ba0be26d27b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:49.337208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c3637ad1-26f5-4b35-9551-2ba0be26d27b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:49.337770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c3637ad1-26f5-4b35-9551-2ba0be26d27b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:49.338549 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c3637ad1-26f5-4b35-9551-2ba0be26d27b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:49.339013 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c3637ad1-26f5-4b35-9551-2ba0be26d27b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:49.484638 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c3637ad1-26f5-4b35-9551-2ba0be26d27b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:49.491959 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c3637ad1-26f5-4b35-9551-2ba0be26d27b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.165172 Mar 08 19:14:49.492521 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 127/255] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:49 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:49.746389 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-30395db1-647b-4883-9184-6f7242fd9c14 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:49.746995 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-30395db1-647b-4883-9184-6f7242fd9c14 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:49.753952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-30395db1-647b-4883-9184-6f7242fd9c14 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:49.754399 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-30395db1-647b-4883-9184-6f7242fd9c14 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:49.755170 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-30395db1-647b-4883-9184-6f7242fd9c14 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:49.755601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-30395db1-647b-4883-9184-6f7242fd9c14 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:49.891767 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-30395db1-647b-4883-9184-6f7242fd9c14 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:49.904780 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-30395db1-647b-4883-9184-6f7242fd9c14 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1552 microversion: 2.1 time: 0.162179 Mar 08 19:14:49.905709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 129/256] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:49 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:50.509658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-add8b1a1-b72d-49b5-a6d6-9dbc1b078b0f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:50.510271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-add8b1a1-b72d-49b5-a6d6-9dbc1b078b0f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:50.517044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-add8b1a1-b72d-49b5-a6d6-9dbc1b078b0f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:50.517549 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-add8b1a1-b72d-49b5-a6d6-9dbc1b078b0f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:50.518308 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-add8b1a1-b72d-49b5-a6d6-9dbc1b078b0f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:50.518743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-add8b1a1-b72d-49b5-a6d6-9dbc1b078b0f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:50.670345 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-add8b1a1-b72d-49b5-a6d6-9dbc1b078b0f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:50.679074 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-add8b1a1-b72d-49b5-a6d6-9dbc1b078b0f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.173186 Mar 08 19:14:50.686088 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 128/257] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:50 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:50.923202 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-26cd1966-2401-4022-838e-0b7619988190 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:50.923981 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-26cd1966-2401-4022-838e-0b7619988190 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:50.930772 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-26cd1966-2401-4022-838e-0b7619988190 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:50.931227 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-26cd1966-2401-4022-838e-0b7619988190 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:50.932029 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-26cd1966-2401-4022-838e-0b7619988190 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:50.932469 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-26cd1966-2401-4022-838e-0b7619988190 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:51.069301 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-26cd1966-2401-4022-838e-0b7619988190 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:51.078140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-26cd1966-2401-4022-838e-0b7619988190 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1552 microversion: 2.1 time: 0.159285 Mar 08 19:14:51.078725 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 130/258] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:50 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:51.696468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-86ba565c-8e53-440c-a97f-c2b80d024e6f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:51.697102 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-86ba565c-8e53-440c-a97f-c2b80d024e6f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:51.703665 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-86ba565c-8e53-440c-a97f-c2b80d024e6f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:51.704946 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-86ba565c-8e53-440c-a97f-c2b80d024e6f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:51.704946 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-86ba565c-8e53-440c-a97f-c2b80d024e6f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:51.705342 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-86ba565c-8e53-440c-a97f-c2b80d024e6f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:51.846081 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-86ba565c-8e53-440c-a97f-c2b80d024e6f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:51.853681 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-86ba565c-8e53-440c-a97f-c2b80d024e6f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.161396 Mar 08 19:14:51.854236 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 129/259] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:51 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:52.095411 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8f9ca2fa-8a87-4c86-a695-0d2fcb16ae04 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:52.096065 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8f9ca2fa-8a87-4c86-a695-0d2fcb16ae04 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:52.102674 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2fa-8a87-4c86-a695-0d2fcb16ae04 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:52.103124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2fa-8a87-4c86-a695-0d2fcb16ae04 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:52.103908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2fa-8a87-4c86-a695-0d2fcb16ae04 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:52.104384 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f9ca2fa-8a87-4c86-a695-0d2fcb16ae04 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:52.270612 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8f9ca2fa-8a87-4c86-a695-0d2fcb16ae04 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:52.281412 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8f9ca2fa-8a87-4c86-a695-0d2fcb16ae04 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1552 microversion: 2.1 time: 0.190044 Mar 08 19:14:52.282034 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 131/260] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:52 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1552 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:52.873850 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f6e19843-66f9-471b-b231-af0348aaab14 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:52.876995 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f6e19843-66f9-471b-b231-af0348aaab14 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:52.895593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6e19843-66f9-471b-b231-af0348aaab14 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:52.896305 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6e19843-66f9-471b-b231-af0348aaab14 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:52.897389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6e19843-66f9-471b-b231-af0348aaab14 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:52.897907 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6e19843-66f9-471b-b231-af0348aaab14 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:52.971211 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-a06b69c5-bf23-470d-a01a-715af0cb76fe req-6f935878-b051-48d7-9cc4-1b268be33869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1764d05-9f73-4c93-99d1-6068a3927cbd", "name": "network-vif-deleted", "tag": "ab1d2653-193c-4b46-89f5-5adf4d0861c9"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:14:52.980285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-a06b69c5-bf23-470d-a01a-715af0cb76fe req-6f935878-b051-48d7-9cc4-1b268be33869 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:52.980895 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-a06b69c5-bf23-470d-a01a-715af0cb76fe req-6f935878-b051-48d7-9cc4-1b268be33869 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:52.993301 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-a06b69c5-bf23-470d-a01a-715af0cb76fe req-6f935878-b051-48d7-9cc4-1b268be33869 service nova] Creating event network-vif-deleted:ab1d2653-193c-4b46-89f5-5adf4d0861c9 for instance b1764d05-9f73-4c93-99d1-6068a3927cbd on hv-cinder-83009 Mar 08 19:14:52.998957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-a06b69c5-bf23-470d-a01a-715af0cb76fe req-6f935878-b051-48d7-9cc4-1b268be33869 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032384 Mar 08 19:14:52.999791 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 132/261] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:14:53.078956 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f6e19843-66f9-471b-b231-af0348aaab14 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:53.086650 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f6e19843-66f9-471b-b231-af0348aaab14 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.219859 Mar 08 19:14:53.087967 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 130/262] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:52 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:53.307535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0e096c83-b5f5-42a1-b68f-d0261526d553 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:53.308904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0e096c83-b5f5-42a1-b68f-d0261526d553 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:53.321515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0e096c83-b5f5-42a1-b68f-d0261526d553 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:53.322134 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0e096c83-b5f5-42a1-b68f-d0261526d553 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:53.323052 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0e096c83-b5f5-42a1-b68f-d0261526d553 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:53.323627 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0e096c83-b5f5-42a1-b68f-d0261526d553 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:53.389603 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0e096c83-b5f5-42a1-b68f-d0261526d553 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:53.397442 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0e096c83-b5f5-42a1-b68f-d0261526d553 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1345 microversion: 2.1 time: 0.094259 Mar 08 19:14:53.398001 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 133/263] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:53 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:14:54.105168 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b1df3a85-429b-4286-8511-d676857168cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:54.105822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b1df3a85-429b-4286-8511-d676857168cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:54.112156 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b1df3a85-429b-4286-8511-d676857168cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:54.112607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b1df3a85-429b-4286-8511-d676857168cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:54.113368 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b1df3a85-429b-4286-8511-d676857168cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:54.113792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b1df3a85-429b-4286-8511-d676857168cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:54.277389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b1df3a85-429b-4286-8511-d676857168cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:54.286311 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b1df3a85-429b-4286-8511-d676857168cc tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.185014 Mar 08 19:14:54.287110 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 131/264] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:54 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:54.420351 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:54.421215 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:54.428410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:54.428410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:54.429735 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:54.430172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:54.469488 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:54.470190 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:54.470643 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lazy-loading 'fault' on Instance uuid b1764d05-9f73-4c93-99d1-6068a3927cbd {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:14:54.521655 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b91a82b4bb5482e9ff050596a43aacf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba7a7a1ddfb54eaa8b255267ec4bde13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:54.529707 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fd08a341-c3df-4708-b9c3-96b86fdca15d tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 200 len: 1350 microversion: 2.1 time: 0.118539 Mar 08 19:14:54.533751 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 134/265] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:54 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 1350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:55.307074 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-799f1e7f-1ee9-4817-b0d8-3953ac793107 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:55.312239 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-799f1e7f-1ee9-4817-b0d8-3953ac793107 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:55.327683 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-799f1e7f-1ee9-4817-b0d8-3953ac793107 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:55.329346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-799f1e7f-1ee9-4817-b0d8-3953ac793107 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:55.331547 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-799f1e7f-1ee9-4817-b0d8-3953ac793107 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:55.332211 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-799f1e7f-1ee9-4817-b0d8-3953ac793107 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:55.550027 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:55.550027 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:55.551213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-799f1e7f-1ee9-4817-b0d8-3953ac793107 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:55.559175 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:55.559811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:55.561654 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:55.563261 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:55.563441 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-799f1e7f-1ee9-4817-b0d8-3953ac793107 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.260641 Mar 08 19:14:55.568284 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 132/266] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:55 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:55.581058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] HTTP exception thrown: Instance b1764d05-9f73-4c93-99d1-6068a3927cbd could not be found. Mar 08 19:14:55.581613 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Returning 404 to user: Instance b1764d05-9f73-4c93-99d1-6068a3927cbd could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:14:55.582466 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-aae3dc44-2cf9-4e1a-bcb3-1b024bb8793a tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 404 len: 111 microversion: 2.1 time: 0.039605 Mar 08 19:14:55.583035 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 135/267] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:55 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:14:55.711848 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:55.713023 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:55.722141 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:55.722601 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:55.724116 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:55.724201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:55.741437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] HTTP exception thrown: Instance b1764d05-9f73-4c93-99d1-6068a3927cbd could not be found. Mar 08 19:14:55.742177 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Returning 404 to user: Instance b1764d05-9f73-4c93-99d1-6068a3927cbd could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:14:55.743544 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-dc56fa0f-c3b3-4965-ae03-82995b59d923 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035525 Mar 08 19:14:55.744144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 133/268] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:14:55 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:14:56.594925 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-97a850eb-499c-4381-aa35-1bab1f8c2930 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:56.595540 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-97a850eb-499c-4381-aa35-1bab1f8c2930 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:56.602232 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-97a850eb-499c-4381-aa35-1bab1f8c2930 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:56.608383 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-97a850eb-499c-4381-aa35-1bab1f8c2930 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:56.608383 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-97a850eb-499c-4381-aa35-1bab1f8c2930 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:56.608383 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-97a850eb-499c-4381-aa35-1bab1f8c2930 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:56.766670 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-97a850eb-499c-4381-aa35-1bab1f8c2930 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:56.774218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-97a850eb-499c-4381-aa35-1bab1f8c2930 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.184051 Mar 08 19:14:56.774770 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 136/269] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:56 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:57.790502 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bf0f1ae5-9e01-406f-af74-911637adc7e7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:57.791144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-bf0f1ae5-9e01-406f-af74-911637adc7e7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:57.797999 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bf0f1ae5-9e01-406f-af74-911637adc7e7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:57.798450 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bf0f1ae5-9e01-406f-af74-911637adc7e7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:57.799231 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bf0f1ae5-9e01-406f-af74-911637adc7e7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:57.799670 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bf0f1ae5-9e01-406f-af74-911637adc7e7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:57.948649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-bf0f1ae5-9e01-406f-af74-911637adc7e7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:57.956294 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bf0f1ae5-9e01-406f-af74-911637adc7e7 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.169566 Mar 08 19:14:57.956869 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 134/270] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:57 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:14:58.973504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a8bd366b-a61e-4905-aa5f-d99e6b6e9d7c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:14:58.974116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a8bd366b-a61e-4905-aa5f-d99e6b6e9d7c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:14:58.980442 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8bd366b-a61e-4905-aa5f-d99e6b6e9d7c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:58.980900 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8bd366b-a61e-4905-aa5f-d99e6b6e9d7c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:58.981680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8bd366b-a61e-4905-aa5f-d99e6b6e9d7c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:14:58.982182 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8bd366b-a61e-4905-aa5f-d99e6b6e9d7c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:14:59.124179 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a8bd366b-a61e-4905-aa5f-d99e6b6e9d7c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:14:59.135125 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a8bd366b-a61e-4905-aa5f-d99e6b6e9d7c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.162204 Mar 08 19:14:59.135125 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 137/271] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:14:58 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:00.150269 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f6ff407d-1c2d-4a4e-a21d-adceb10d2cbf tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:00.150956 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f6ff407d-1c2d-4a4e-a21d-adceb10d2cbf tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:00.157909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6ff407d-1c2d-4a4e-a21d-adceb10d2cbf tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:00.158351 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6ff407d-1c2d-4a4e-a21d-adceb10d2cbf tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:00.159118 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6ff407d-1c2d-4a4e-a21d-adceb10d2cbf tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:00.159548 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6ff407d-1c2d-4a4e-a21d-adceb10d2cbf tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:00.293936 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f6ff407d-1c2d-4a4e-a21d-adceb10d2cbf tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:00.301679 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f6ff407d-1c2d-4a4e-a21d-adceb10d2cbf tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.155644 Mar 08 19:15:00.302333 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 135/272] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:00 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:01.319401 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-716600ca-8c6f-417e-9dcd-79e62a2af93e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:01.320035 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-716600ca-8c6f-417e-9dcd-79e62a2af93e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:01.327992 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-716600ca-8c6f-417e-9dcd-79e62a2af93e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:01.327992 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-716600ca-8c6f-417e-9dcd-79e62a2af93e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:01.328776 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-716600ca-8c6f-417e-9dcd-79e62a2af93e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:01.329198 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-716600ca-8c6f-417e-9dcd-79e62a2af93e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:01.471176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-716600ca-8c6f-417e-9dcd-79e62a2af93e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:01.483208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-716600ca-8c6f-417e-9dcd-79e62a2af93e tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.166070 Mar 08 19:15:01.483208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 138/273] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:01 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:02.414903 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:02.415434 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:02.422334 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:02.422749 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:02.423507 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:02.424109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:02.439120 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] HTTP exception thrown: Instance b1764d05-9f73-4c93-99d1-6068a3927cbd could not be found. Mar 08 19:15:02.439612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Returning 404 to user: Instance b1764d05-9f73-4c93-99d1-6068a3927cbd could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:15:02.440458 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5f804add-18f1-4cd5-8a95-3aa2ca210aa4 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 404 len: 111 microversion: 2.1 time: 0.029604 Mar 08 19:15:02.441088 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 136/274] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:15:02 2022] DELETE /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:15:02.449043 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:02.449649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] [instance: b1764d05-9f73-4c93-99d1-6068a3927cbd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:02.456002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:02.456504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:02.457261 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:02.457727 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:02.471176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] HTTP exception thrown: Instance b1764d05-9f73-4c93-99d1-6068a3927cbd could not be found. Mar 08 19:15:02.471791 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] Returning 404 to user: Instance b1764d05-9f73-4c93-99d1-6068a3927cbd could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:15:02.472649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b18351f9-b172-433e-821f-a8f9b8f358c1 tempest-DeleteServersTestJSON-1253433282 tempest-DeleteServersTestJSON-1253433282-project] 10.222.0.75 "GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd" status: 404 len: 111 microversion: 2.1 time: 0.027413 Mar 08 19:15:02.473185 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 139/275] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:02 2022] GET /compute/v2.1/servers/b1764d05-9f73-4c93-99d1-6068a3927cbd => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:15:02.500254 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5d23c12a-0ea2-44cd-abb7-aef722975c42 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:02.500965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5d23c12a-0ea2-44cd-abb7-aef722975c42 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:02.506825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5d23c12a-0ea2-44cd-abb7-aef722975c42 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:02.507276 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5d23c12a-0ea2-44cd-abb7-aef722975c42 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:02.508087 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5d23c12a-0ea2-44cd-abb7-aef722975c42 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:02.508523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5d23c12a-0ea2-44cd-abb7-aef722975c42 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:02.647902 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5d23c12a-0ea2-44cd-abb7-aef722975c42 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:02.657392 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5d23c12a-0ea2-44cd-abb7-aef722975c42 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.161239 Mar 08 19:15:02.658052 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 137/276] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:02 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:03.675457 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-eed9f5a7-fecc-4f26-a70d-a0e8a7647ff0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:03.676829 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-eed9f5a7-fecc-4f26-a70d-a0e8a7647ff0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:03.687566 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-eed9f5a7-fecc-4f26-a70d-a0e8a7647ff0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:03.692033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-eed9f5a7-fecc-4f26-a70d-a0e8a7647ff0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:03.692033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-eed9f5a7-fecc-4f26-a70d-a0e8a7647ff0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:03.692033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-eed9f5a7-fecc-4f26-a70d-a0e8a7647ff0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:03.846165 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-eed9f5a7-fecc-4f26-a70d-a0e8a7647ff0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:03.853979 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-eed9f5a7-fecc-4f26-a70d-a0e8a7647ff0 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.182436 Mar 08 19:15:03.854547 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 140/277] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:03 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:04.870551 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-773c7fb0-69c3-4404-9a4f-f224440bc593 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:04.871682 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-773c7fb0-69c3-4404-9a4f-f224440bc593 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:04.877695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-773c7fb0-69c3-4404-9a4f-f224440bc593 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:04.878150 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-773c7fb0-69c3-4404-9a4f-f224440bc593 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:04.878920 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-773c7fb0-69c3-4404-9a4f-f224440bc593 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:04.879372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-773c7fb0-69c3-4404-9a4f-f224440bc593 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:05.021787 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-773c7fb0-69c3-4404-9a4f-f224440bc593 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:05.029770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-773c7fb0-69c3-4404-9a4f-f224440bc593 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.162930 Mar 08 19:15:05.030439 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 138/278] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:04 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:06.047343 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8f471e5a-5271-4552-97e8-9b37ff16b71f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:06.047888 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8f471e5a-5271-4552-97e8-9b37ff16b71f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:06.055213 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f471e5a-5271-4552-97e8-9b37ff16b71f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:06.055668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f471e5a-5271-4552-97e8-9b37ff16b71f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:06.057704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f471e5a-5271-4552-97e8-9b37ff16b71f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:06.057704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f471e5a-5271-4552-97e8-9b37ff16b71f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:06.189243 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8f471e5a-5271-4552-97e8-9b37ff16b71f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:06.196466 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8f471e5a-5271-4552-97e8-9b37ff16b71f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.153174 Mar 08 19:15:06.197080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 141/279] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:06 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:07.213989 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c038d9a4-a5fc-4203-b66c-e0899c3ec58f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:07.214593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c038d9a4-a5fc-4203-b66c-e0899c3ec58f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:07.221055 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c038d9a4-a5fc-4203-b66c-e0899c3ec58f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:07.222430 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c038d9a4-a5fc-4203-b66c-e0899c3ec58f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:07.222430 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c038d9a4-a5fc-4203-b66c-e0899c3ec58f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:07.222838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c038d9a4-a5fc-4203-b66c-e0899c3ec58f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:07.350948 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c038d9a4-a5fc-4203-b66c-e0899c3ec58f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:07.360421 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c038d9a4-a5fc-4203-b66c-e0899c3ec58f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.149224 Mar 08 19:15:07.362440 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 139/280] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:07 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:15:08.379950 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2f7010de-b2bf-49b2-bb65-a23eab513483 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:08.380658 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2f7010de-b2bf-49b2-bb65-a23eab513483 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:08.386840 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2f7010de-b2bf-49b2-bb65-a23eab513483 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:08.387291 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2f7010de-b2bf-49b2-bb65-a23eab513483 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:08.388984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2f7010de-b2bf-49b2-bb65-a23eab513483 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:08.389431 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2f7010de-b2bf-49b2-bb65-a23eab513483 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:08.521103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2f7010de-b2bf-49b2-bb65-a23eab513483 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:08.529637 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2f7010de-b2bf-49b2-bb65-a23eab513483 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.152810 Mar 08 19:15:08.530638 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 142/281] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:08 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:09.546736 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fb7a3332-daea-4cfd-99f1-1b33a0f2ff6a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:09.547230 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fb7a3332-daea-4cfd-99f1-1b33a0f2ff6a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:09.553143 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fb7a3332-daea-4cfd-99f1-1b33a0f2ff6a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:09.553583 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fb7a3332-daea-4cfd-99f1-1b33a0f2ff6a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:09.554346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fb7a3332-daea-4cfd-99f1-1b33a0f2ff6a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:09.554783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fb7a3332-daea-4cfd-99f1-1b33a0f2ff6a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:09.707720 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fb7a3332-daea-4cfd-99f1-1b33a0f2ff6a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:09.717123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fb7a3332-daea-4cfd-99f1-1b33a0f2ff6a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.173755 Mar 08 19:15:09.717699 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 140/282] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:09 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:10.737913 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ee741780-3b84-47b5-926d-6d683d617dba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:10.738523 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ee741780-3b84-47b5-926d-6d683d617dba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:10.744962 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ee741780-3b84-47b5-926d-6d683d617dba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:10.745422 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ee741780-3b84-47b5-926d-6d683d617dba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:10.746240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ee741780-3b84-47b5-926d-6d683d617dba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:10.746682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ee741780-3b84-47b5-926d-6d683d617dba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:10.878008 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ee741780-3b84-47b5-926d-6d683d617dba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:10.885270 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ee741780-3b84-47b5-926d-6d683d617dba tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.153444 Mar 08 19:15:10.885833 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 143/283] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:10 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:11.902442 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f9ac0dd0-e5bf-4d35-aaf9-1ad5c8c69f73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:11.903054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f9ac0dd0-e5bf-4d35-aaf9-1ad5c8c69f73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:11.908941 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f9ac0dd0-e5bf-4d35-aaf9-1ad5c8c69f73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:11.909399 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f9ac0dd0-e5bf-4d35-aaf9-1ad5c8c69f73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:11.910171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f9ac0dd0-e5bf-4d35-aaf9-1ad5c8c69f73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:11.910611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f9ac0dd0-e5bf-4d35-aaf9-1ad5c8c69f73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:12.041896 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f9ac0dd0-e5bf-4d35-aaf9-1ad5c8c69f73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:12.049934 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f9ac0dd0-e5bf-4d35-aaf9-1ad5c8c69f73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.151370 Mar 08 19:15:12.050494 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 141/284] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:11 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:13.067073 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c2f289f9-7a47-4242-8f49-ffe84f57da88 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:13.067789 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c2f289f9-7a47-4242-8f49-ffe84f57da88 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:13.074164 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c2f289f9-7a47-4242-8f49-ffe84f57da88 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:13.074614 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c2f289f9-7a47-4242-8f49-ffe84f57da88 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:13.076154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c2f289f9-7a47-4242-8f49-ffe84f57da88 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:13.076601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c2f289f9-7a47-4242-8f49-ffe84f57da88 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:13.210985 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c2f289f9-7a47-4242-8f49-ffe84f57da88 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:13.221699 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c2f289f9-7a47-4242-8f49-ffe84f57da88 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.158296 Mar 08 19:15:13.222667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 144/285] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:13 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:14.239132 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-df6b5963-c8f5-497c-86f5-f917f4d33cf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:14.239734 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-df6b5963-c8f5-497c-86f5-f917f4d33cf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:14.245873 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-df6b5963-c8f5-497c-86f5-f917f4d33cf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:14.246323 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-df6b5963-c8f5-497c-86f5-f917f4d33cf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:14.247184 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-df6b5963-c8f5-497c-86f5-f917f4d33cf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:14.247655 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-df6b5963-c8f5-497c-86f5-f917f4d33cf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:14.388978 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-df6b5963-c8f5-497c-86f5-f917f4d33cf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:14.396823 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-df6b5963-c8f5-497c-86f5-f917f4d33cf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.161770 Mar 08 19:15:14.397390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 142/286] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:14 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:15.336615 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-42ee3c81-b91a-45ad-9255-5e1988f56364 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f4390aa20d0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:15.384335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-42ee3c81-b91a-45ad-9255-5e1988f56364 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/d50e50b1-eb29-4d6c-81ab-0351f0225a7d" status: 200 len: 350 microversion: 2.1 time: 0.051489 Mar 08 19:15:15.385210 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 145/287] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:15:15 2022] GET /compute/v2.1/os-volumes/d50e50b1-eb29-4d6c-81ab-0351f0225a7d => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:15:15.414276 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2a33d7c8-7556-4fef-b388-8029042eabed tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:15.414979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2a33d7c8-7556-4fef-b388-8029042eabed tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:15.420926 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2a33d7c8-7556-4fef-b388-8029042eabed tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:15.421439 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2a33d7c8-7556-4fef-b388-8029042eabed tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:15.422315 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2a33d7c8-7556-4fef-b388-8029042eabed tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:15.422799 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2a33d7c8-7556-4fef-b388-8029042eabed tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:15.615861 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2a33d7c8-7556-4fef-b388-8029042eabed tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:15.643237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2a33d7c8-7556-4fef-b388-8029042eabed tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.233053 Mar 08 19:15:15.657793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 143/288] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:15 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:16.665731 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b85df61a-28bb-471f-a279-e0b0c1561106 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:16.666294 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b85df61a-28bb-471f-a279-e0b0c1561106 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:16.673112 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b85df61a-28bb-471f-a279-e0b0c1561106 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:16.673550 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b85df61a-28bb-471f-a279-e0b0c1561106 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:16.674310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b85df61a-28bb-471f-a279-e0b0c1561106 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:16.674738 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b85df61a-28bb-471f-a279-e0b0c1561106 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:16.815239 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b85df61a-28bb-471f-a279-e0b0c1561106 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:16.822753 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b85df61a-28bb-471f-a279-e0b0c1561106 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1521 microversion: 2.1 time: 0.161391 Mar 08 19:15:16.823344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 146/289] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:16 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:17.840990 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0fa8e2d3-2b34-4612-afea-f8120ef25303 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:17.841589 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0fa8e2d3-2b34-4612-afea-f8120ef25303 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:17.848305 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0fa8e2d3-2b34-4612-afea-f8120ef25303 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:17.848753 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0fa8e2d3-2b34-4612-afea-f8120ef25303 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:17.849503 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0fa8e2d3-2b34-4612-afea-f8120ef25303 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:17.849937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0fa8e2d3-2b34-4612-afea-f8120ef25303 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:18.013014 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0fa8e2d3-2b34-4612-afea-f8120ef25303 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:18.020945 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0fa8e2d3-2b34-4612-afea-f8120ef25303 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1501 microversion: 2.1 time: 0.183656 Mar 08 19:15:18.021509 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 144/290] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:17 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:18.038096 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b084b6e8-e7d2-4cb9-afeb-9f810a0c493b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:18.038570 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b084b6e8-e7d2-4cb9-afeb-9f810a0c493b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:18.044993 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b084b6e8-e7d2-4cb9-afeb-9f810a0c493b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:18.045792 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b084b6e8-e7d2-4cb9-afeb-9f810a0c493b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:18.046633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b084b6e8-e7d2-4cb9-afeb-9f810a0c493b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:18.047318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b084b6e8-e7d2-4cb9-afeb-9f810a0c493b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:18.188428 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b084b6e8-e7d2-4cb9-afeb-9f810a0c493b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:18.197317 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b084b6e8-e7d2-4cb9-afeb-9f810a0c493b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1515 microversion: 2.1 time: 0.164306 Mar 08 19:15:18.198133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 147/291] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:18 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:18.442669 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-44b36435-f901-494e-82ed-a387fbfe6a0d tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f43902a35e0>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:18.748110 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-44b36435-f901-494e-82ed-a387fbfe6a0d tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/1706d8c0-8403-4edb-9d13-102685974aeb" status: 200 len: 351 microversion: 2.1 time: 0.310999 Mar 08 19:15:18.748849 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 145/292] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:15:18 2022] GET /compute/v2.1/os-volumes/1706d8c0-8403-4edb-9d13-102685974aeb => generated 351 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:15:20.241578 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-59369ed9-70e9-4277-a3c7-ae683fe86f1d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:20.243121 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-59369ed9-70e9-4277-a3c7-ae683fe86f1d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:20.253239 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59369ed9-70e9-4277-a3c7-ae683fe86f1d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:20.254144 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59369ed9-70e9-4277-a3c7-ae683fe86f1d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:20.255621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59369ed9-70e9-4277-a3c7-ae683fe86f1d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:20.256607 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59369ed9-70e9-4277-a3c7-ae683fe86f1d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:20.280233 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-59369ed9-70e9-4277-a3c7-ae683fe86f1d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lazy-loading 'flavor' on Instance uuid 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:15:20.534395 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-59369ed9-70e9-4277-a3c7-ae683fe86f1d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/action" status: 200 len: 32 microversion: 2.1 time: 0.299929 Mar 08 19:15:20.534995 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 148/293] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:15:20 2022] POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:15:20.543885 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9d0117e9-5ba9-47e2-99bf-dcb27b32adc4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:20.544484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9d0117e9-5ba9-47e2-99bf-dcb27b32adc4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:20.551044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d0117e9-5ba9-47e2-99bf-dcb27b32adc4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:20.551495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d0117e9-5ba9-47e2-99bf-dcb27b32adc4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:20.552290 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d0117e9-5ba9-47e2-99bf-dcb27b32adc4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:20.552728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d0117e9-5ba9-47e2-99bf-dcb27b32adc4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:20.698675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9d0117e9-5ba9-47e2-99bf-dcb27b32adc4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:20.706991 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9d0117e9-5ba9-47e2-99bf-dcb27b32adc4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.166833 Mar 08 19:15:20.707750 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 146/294] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:20 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:21.535641 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fa8234f0-679e-4ce4-83bc-541320033472 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f4390122940>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:21.585238 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fa8234f0-679e-4ce4-83bc-541320033472 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/68c46423-ef7f-4dab-948a-c4416d12c987" status: 200 len: 351 microversion: 2.1 time: 0.053787 Mar 08 19:15:21.585883 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 149/295] 10.222.0.75 () {58 vars in 1244 bytes} [Tue Mar 8 19:15:21 2022] GET /compute/v2.1/os-volumes/68c46423-ef7f-4dab-948a-c4416d12c987 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:15:21.596864 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-97e18b24-b5c1-4235-9009-f5c7ac48583a tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f43902a3d30>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:21.688173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-97e18b24-b5c1-4235-9009-f5c7ac48583a tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094978 Mar 08 19:15:21.688732 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 147/296] 10.222.0.75 () {58 vars in 1133 bytes} [Tue Mar 8 19:15:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:21.706423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-53e2228a-9899-4009-b137-186272b59f04 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f4390194af0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:21.729429 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b6a77c58-47c5-42f2-819d-c6d2194f2071 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:21.730967 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b6a77c58-47c5-42f2-819d-c6d2194f2071 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:21.745208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b6a77c58-47c5-42f2-819d-c6d2194f2071 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:21.745821 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b6a77c58-47c5-42f2-819d-c6d2194f2071 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:21.747114 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b6a77c58-47c5-42f2-819d-c6d2194f2071 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:21.748280 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b6a77c58-47c5-42f2-819d-c6d2194f2071 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:21.851294 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-53e2228a-9899-4009-b137-186272b59f04 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.150705 Mar 08 19:15:21.852395 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 150/297] 10.222.0.75 () {58 vars in 1148 bytes} [Tue Mar 8 19:15:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:15:21.866492 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c7ef4835-a0fc-4c65-98af-b1aeb167ebff tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f43926d0040>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:21.997688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c7ef4835-a0fc-4c65-98af-b1aeb167ebff tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.136960 Mar 08 19:15:21.998253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 151/298] 10.222.0.75 () {58 vars in 1133 bytes} [Tue Mar 8 19:15:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:22.010234 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a124a565-fc94-4c02-bcd0-f3e40189914d tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f43900b1f70>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:22.106285 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b6a77c58-47c5-42f2-819d-c6d2194f2071 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:22.124096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b6a77c58-47c5-42f2-819d-c6d2194f2071 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.397797 Mar 08 19:15:22.124096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 148/299] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:21 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:22.124322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a124a565-fc94-4c02-bcd0-f3e40189914d tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.114123 Mar 08 19:15:22.124322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 152/300] 10.222.0.75 () {58 vars in 1166 bytes} [Tue Mar 8 19:15:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:15:22.134288 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f53cd007-a20a-4177-85ab-093bbb335b3e tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f4391b824c0>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:22.254593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f53cd007-a20a-4177-85ab-093bbb335b3e tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.124305 Mar 08 19:15:22.255480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 149/301] 10.222.0.75 () {58 vars in 1169 bytes} [Tue Mar 8 19:15:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:15:22.270601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-09c0008e-aa5a-42e8-ac67-d625f9fe8832 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f43900fc160>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:22.366867 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-09c0008e-aa5a-42e8-ac67-d625f9fe8832 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100730 Mar 08 19:15:22.371993 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 153/302] 10.222.0.75 () {58 vars in 1154 bytes} [Tue Mar 8 19:15:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:22.380069 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a71cb89a-4ff4-43c5-9e49-2bb3d9016a6c tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f4390295670>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:22.476501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a71cb89a-4ff4-43c5-9e49-2bb3d9016a6c tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099822 Mar 08 19:15:22.477220 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 150/303] 10.222.0.75 () {58 vars in 1187 bytes} [Tue Mar 8 19:15:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:15:22.489313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-13fede75-ddbf-43af-ab7a-5b6bdf929fa4 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] Calling method '.version_select at 0x7f43901105e0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:22.572880 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-13fede75-ddbf-43af-ab7a-5b6bdf929fa4 tempest-VolumesTestJSON-609798759 tempest-VolumesTestJSON-609798759-project] 10.222.0.75 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087574 Mar 08 19:15:22.573481 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 154/304] 10.222.0.75 () {58 vars in 1154 bytes} [Tue Mar 8 19:15:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:23.139641 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c4a46d23-f177-45f6-8d64-b17620cfcb5c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:23.140485 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c4a46d23-f177-45f6-8d64-b17620cfcb5c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:23.147848 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4a46d23-f177-45f6-8d64-b17620cfcb5c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:23.151588 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4a46d23-f177-45f6-8d64-b17620cfcb5c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:23.151588 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4a46d23-f177-45f6-8d64-b17620cfcb5c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:23.151588 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4a46d23-f177-45f6-8d64-b17620cfcb5c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:23.328601 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c4a46d23-f177-45f6-8d64-b17620cfcb5c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:23.337546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c4a46d23-f177-45f6-8d64-b17620cfcb5c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.202768 Mar 08 19:15:23.338332 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 151/305] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:23 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:15:24.366366 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cd20bc1d-8cba-4949-b0ca-2a27be0c0078 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:24.367008 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cd20bc1d-8cba-4949-b0ca-2a27be0c0078 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:24.373437 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd20bc1d-8cba-4949-b0ca-2a27be0c0078 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:24.373583 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd20bc1d-8cba-4949-b0ca-2a27be0c0078 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:24.374486 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd20bc1d-8cba-4949-b0ca-2a27be0c0078 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:24.374834 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd20bc1d-8cba-4949-b0ca-2a27be0c0078 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:24.514498 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cd20bc1d-8cba-4949-b0ca-2a27be0c0078 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:24.522416 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cd20bc1d-8cba-4949-b0ca-2a27be0c0078 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.161489 Mar 08 19:15:24.522980 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 155/306] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:24 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:25.539283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a602bcde-50c9-4fa7-aa02-bf18a0d5a594 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:25.539960 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a602bcde-50c9-4fa7-aa02-bf18a0d5a594 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:25.545789 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a602bcde-50c9-4fa7-aa02-bf18a0d5a594 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:25.546241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a602bcde-50c9-4fa7-aa02-bf18a0d5a594 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:25.547013 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a602bcde-50c9-4fa7-aa02-bf18a0d5a594 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:25.547567 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a602bcde-50c9-4fa7-aa02-bf18a0d5a594 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:25.722762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a602bcde-50c9-4fa7-aa02-bf18a0d5a594 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:25.730314 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a602bcde-50c9-4fa7-aa02-bf18a0d5a594 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.195064 Mar 08 19:15:25.730883 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 152/307] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:25 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:26.748279 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-46f3dfa5-8fa8-4348-802c-a4c6f6efa0da tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:26.748925 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-46f3dfa5-8fa8-4348-802c-a4c6f6efa0da tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:26.755619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-46f3dfa5-8fa8-4348-802c-a4c6f6efa0da tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:26.756121 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-46f3dfa5-8fa8-4348-802c-a4c6f6efa0da tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:26.756903 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-46f3dfa5-8fa8-4348-802c-a4c6f6efa0da tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:26.757344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-46f3dfa5-8fa8-4348-802c-a4c6f6efa0da tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:26.915975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-46f3dfa5-8fa8-4348-802c-a4c6f6efa0da tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:26.921591 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-46f3dfa5-8fa8-4348-802c-a4c6f6efa0da tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.177263 Mar 08 19:15:26.922174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 156/308] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:26 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:27.938554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8390d9be-d904-4aea-9437-06d8310031af tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:27.939884 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8390d9be-d904-4aea-9437-06d8310031af tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:27.945825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8390d9be-d904-4aea-9437-06d8310031af tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:27.946269 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8390d9be-d904-4aea-9437-06d8310031af tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:27.947027 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8390d9be-d904-4aea-9437-06d8310031af tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:27.947464 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8390d9be-d904-4aea-9437-06d8310031af tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:28.083817 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8390d9be-d904-4aea-9437-06d8310031af tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:28.091495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8390d9be-d904-4aea-9437-06d8310031af tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.156771 Mar 08 19:15:28.101686 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 153/309] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:27 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:29.109310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1cde84ad-baff-4b29-aa57-a7c1ada0c210 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:29.110167 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1cde84ad-baff-4b29-aa57-a7c1ada0c210 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:29.119657 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1cde84ad-baff-4b29-aa57-a7c1ada0c210 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:29.120378 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1cde84ad-baff-4b29-aa57-a7c1ada0c210 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:29.121313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1cde84ad-baff-4b29-aa57-a7c1ada0c210 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:29.121895 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1cde84ad-baff-4b29-aa57-a7c1ada0c210 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:29.267295 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1cde84ad-baff-4b29-aa57-a7c1ada0c210 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:29.275884 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1cde84ad-baff-4b29-aa57-a7c1ada0c210 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.171040 Mar 08 19:15:29.281934 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 157/310] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:29 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:29.603133 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-41563781", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "networks": [{"uuid": "3eaa1a64-1730-4b60-97b5-c1f5e0ba8463"}]}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:29.658814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] validate_networks() for [('3eaa1a64-1730-4b60-97b5-c1f5e0ba8463', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:15:30.033700 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:15:30.034420 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:15:30.034900 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:15:30.035360 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:15:30.035897 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:15:30.051982 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:30.057361 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:30.057361 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:30.057361 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:30.074175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Getting quotas for project f10261552daf4cb9a0cf1b53cb019b42. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:15:30.078465 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Getting quotas for user b56bbaadcca041fe89e65bfb79526a8d and project f10261552daf4cb9a0cf1b53cb019b42. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:15:30.097267 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:15:30.099641 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:15:30.266049 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5add5d8b-2a95-45a0-b15b-e61b2222fa51 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668919 Mar 08 19:15:30.266685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 154/311] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:15:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:15:30.280032 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0d68bc20-fc10-41ef-b2ef-32a2bcb28073 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:30.280032 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0d68bc20-fc10-41ef-b2ef-32a2bcb28073 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:30.294859 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-785018fd-31ce-4902-a9f5-cd5d8d09e3d4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:30.296933 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-785018fd-31ce-4902-a9f5-cd5d8d09e3d4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:30.318770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-785018fd-31ce-4902-a9f5-cd5d8d09e3d4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:30.318770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-785018fd-31ce-4902-a9f5-cd5d8d09e3d4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:30.320228 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-785018fd-31ce-4902-a9f5-cd5d8d09e3d4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:30.320693 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-785018fd-31ce-4902-a9f5-cd5d8d09e3d4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:30.359840 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0d68bc20-fc10-41ef-b2ef-32a2bcb28073 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:30.368675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0d68bc20-fc10-41ef-b2ef-32a2bcb28073 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1217 microversion: 2.1 time: 0.095721 Mar 08 19:15:30.380091 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 158/312] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:30 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:30.530125 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-785018fd-31ce-4902-a9f5-cd5d8d09e3d4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:30.538848 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-785018fd-31ce-4902-a9f5-cd5d8d09e3d4 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.248338 Mar 08 19:15:30.539408 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 155/313] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:30 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:15:31.388513 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f55ccc30-1749-44e6-956b-041ca1ae2504 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:31.389106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f55ccc30-1749-44e6-956b-041ca1ae2504 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:31.396000 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f55ccc30-1749-44e6-956b-041ca1ae2504 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:31.396455 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f55ccc30-1749-44e6-956b-041ca1ae2504 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:31.397271 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f55ccc30-1749-44e6-956b-041ca1ae2504 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:31.397705 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f55ccc30-1749-44e6-956b-041ca1ae2504 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:31.471129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f55ccc30-1749-44e6-956b-041ca1ae2504 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:31.479438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f55ccc30-1749-44e6-956b-041ca1ae2504 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1221 microversion: 2.1 time: 0.095242 Mar 08 19:15:31.480853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 159/314] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:31 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:31.556458 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-37774cec-1264-45b4-81fc-aaa0bbd0d2d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:31.557220 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-37774cec-1264-45b4-81fc-aaa0bbd0d2d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:31.564330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-37774cec-1264-45b4-81fc-aaa0bbd0d2d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:31.567164 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-37774cec-1264-45b4-81fc-aaa0bbd0d2d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:31.567164 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-37774cec-1264-45b4-81fc-aaa0bbd0d2d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:31.567164 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-37774cec-1264-45b4-81fc-aaa0bbd0d2d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:31.703068 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-37774cec-1264-45b4-81fc-aaa0bbd0d2d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:31.711238 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-37774cec-1264-45b4-81fc-aaa0bbd0d2d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1501 microversion: 2.1 time: 0.159141 Mar 08 19:15:31.711873 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 156/315] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:31 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:31.728982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23689402-f9e2-4d32-a1a3-11ef8e8b43e9"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:31.730079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:31.736159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:31.736580 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:31.737563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:31.737985 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:31.760826 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] HTTP exception thrown: Cannot 'attach_volume' instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 while it is in vm_state rescued Mar 08 19:15:31.767868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Returning 409 to user: Cannot 'attach_volume' instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 while it is in vm_state rescued {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:15:31.767868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8b134f88-dc65-4068-9a0b-c126ac0b9960 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037322 Mar 08 19:15:31.767868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 160/316] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:15:31 2022] POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments => generated 152 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 08 19:15:31.775548 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d7dce450-98e5-4fcd-bbbc-767defdf52d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:31.776121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d7dce450-98e5-4fcd-bbbc-767defdf52d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:31.782204 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d7dce450-98e5-4fcd-bbbc-767defdf52d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:31.782732 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d7dce450-98e5-4fcd-bbbc-767defdf52d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:31.783498 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d7dce450-98e5-4fcd-bbbc-767defdf52d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:31.783960 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d7dce450-98e5-4fcd-bbbc-767defdf52d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:32.071454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d7dce450-98e5-4fcd-bbbc-767defdf52d8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.299770 Mar 08 19:15:32.072463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 157/317] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:15:31 2022] POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:15:32.080259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1a99fe2b-ac64-4822-ad28-2b120d8b45eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:32.080861 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1a99fe2b-ac64-4822-ad28-2b120d8b45eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:32.087046 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1a99fe2b-ac64-4822-ad28-2b120d8b45eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:32.087494 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1a99fe2b-ac64-4822-ad28-2b120d8b45eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:32.088321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1a99fe2b-ac64-4822-ad28-2b120d8b45eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:32.089103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1a99fe2b-ac64-4822-ad28-2b120d8b45eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:32.242055 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1a99fe2b-ac64-4822-ad28-2b120d8b45eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:32.249865 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1a99fe2b-ac64-4822-ad28-2b120d8b45eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1509 microversion: 2.1 time: 0.173642 Mar 08 19:15:32.250688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 161/318] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:32 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:32.498505 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0911b595-e79e-4971-a6dc-1eefcabbc7e9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:32.499215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0911b595-e79e-4971-a6dc-1eefcabbc7e9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:32.507491 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0911b595-e79e-4971-a6dc-1eefcabbc7e9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:32.508014 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0911b595-e79e-4971-a6dc-1eefcabbc7e9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:32.508785 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0911b595-e79e-4971-a6dc-1eefcabbc7e9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:32.509268 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0911b595-e79e-4971-a6dc-1eefcabbc7e9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:32.603767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0911b595-e79e-4971-a6dc-1eefcabbc7e9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:32.611751 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0911b595-e79e-4971-a6dc-1eefcabbc7e9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1269 microversion: 2.1 time: 0.118128 Mar 08 19:15:32.612335 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 158/319] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:32 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1269 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:33.269046 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8ba3ded4-2bf1-43ee-aa1a-271b8a5ea23d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:33.270268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8ba3ded4-2bf1-43ee-aa1a-271b8a5ea23d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:33.276850 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8ba3ded4-2bf1-43ee-aa1a-271b8a5ea23d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:33.277304 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8ba3ded4-2bf1-43ee-aa1a-271b8a5ea23d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:33.278103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8ba3ded4-2bf1-43ee-aa1a-271b8a5ea23d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:33.278548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8ba3ded4-2bf1-43ee-aa1a-271b8a5ea23d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:33.519032 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8ba3ded4-2bf1-43ee-aa1a-271b8a5ea23d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:33.527146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8ba3ded4-2bf1-43ee-aa1a-271b8a5ea23d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1509 microversion: 2.1 time: 0.262376 Mar 08 19:15:33.527654 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 162/320] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:33 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:15:33.632156 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-091d256c-f371-43c3-b9d8-ca9fe6daf764 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:33.632765 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-091d256c-f371-43c3-b9d8-ca9fe6daf764 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:33.639345 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-091d256c-f371-43c3-b9d8-ca9fe6daf764 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:33.639796 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-091d256c-f371-43c3-b9d8-ca9fe6daf764 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:33.640595 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-091d256c-f371-43c3-b9d8-ca9fe6daf764 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:33.641027 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-091d256c-f371-43c3-b9d8-ca9fe6daf764 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:33.710524 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-091d256c-f371-43c3-b9d8-ca9fe6daf764 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:33.718189 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-091d256c-f371-43c3-b9d8-ca9fe6daf764 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1275 microversion: 2.1 time: 0.089932 Mar 08 19:15:33.718992 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 159/321] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:33 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:34.551446 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8c555c37-95fb-4b76-ac8b-e7cc355222e3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:34.552146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8c555c37-95fb-4b76-ac8b-e7cc355222e3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:34.560059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8c555c37-95fb-4b76-ac8b-e7cc355222e3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:34.560573 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8c555c37-95fb-4b76-ac8b-e7cc355222e3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:34.561657 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8c555c37-95fb-4b76-ac8b-e7cc355222e3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:34.562323 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8c555c37-95fb-4b76-ac8b-e7cc355222e3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:34.737498 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-15511f17-d363-4ddd-a917-449ad3f3d438 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:34.738769 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-15511f17-d363-4ddd-a917-449ad3f3d438 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:34.745918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15511f17-d363-4ddd-a917-449ad3f3d438 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:34.746620 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15511f17-d363-4ddd-a917-449ad3f3d438 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:34.747590 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15511f17-d363-4ddd-a917-449ad3f3d438 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:34.748276 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15511f17-d363-4ddd-a917-449ad3f3d438 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:34.806879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8c555c37-95fb-4b76-ac8b-e7cc355222e3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:34.820156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8c555c37-95fb-4b76-ac8b-e7cc355222e3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1509 microversion: 2.1 time: 0.277638 Mar 08 19:15:34.821416 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 163/322] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:34 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:34.929947 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-15511f17-d363-4ddd-a917-449ad3f3d438 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:34.937405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-15511f17-d363-4ddd-a917-449ad3f3d438 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1317 microversion: 2.1 time: 0.205385 Mar 08 19:15:34.937960 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 160/323] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:34 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1317 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:15:35.001689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-c99abf94-5eac-4fe3-b36e-ff947b777fd5 req-bd3614e1-972e-44e3-900a-e3a6cdd12fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34bb0f82-aeaa-42b9-b40a-c5217b7a2115", "tag": "72fb0b49-ef73-4842-996c-d54211ee6abb"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:35.011709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-c99abf94-5eac-4fe3-b36e-ff947b777fd5 req-bd3614e1-972e-44e3-900a-e3a6cdd12fc2 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:35.012451 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-c99abf94-5eac-4fe3-b36e-ff947b777fd5 req-bd3614e1-972e-44e3-900a-e3a6cdd12fc2 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:35.024718 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-c99abf94-5eac-4fe3-b36e-ff947b777fd5 req-bd3614e1-972e-44e3-900a-e3a6cdd12fc2 service nova] Creating event network-changed:72fb0b49-ef73-4842-996c-d54211ee6abb for instance 34bb0f82-aeaa-42b9-b40a-c5217b7a2115 on hv-cinder-83009 Mar 08 19:15:35.029989 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-c99abf94-5eac-4fe3-b36e-ff947b777fd5 req-bd3614e1-972e-44e3-900a-e3a6cdd12fc2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031945 Mar 08 19:15:35.030850 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 164/324] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:15:35.838987 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3e200941-40b6-4ccc-873a-acaa5c88a30d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:35.840039 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3e200941-40b6-4ccc-873a-acaa5c88a30d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:35.847027 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3e200941-40b6-4ccc-873a-acaa5c88a30d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:35.847473 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3e200941-40b6-4ccc-873a-acaa5c88a30d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:35.848365 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3e200941-40b6-4ccc-873a-acaa5c88a30d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:35.848721 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3e200941-40b6-4ccc-873a-acaa5c88a30d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:35.960092 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d18cebff-25b6-404b-bb2b-db290bcfafa7 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:35.960831 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d18cebff-25b6-404b-bb2b-db290bcfafa7 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:35.967670 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d18cebff-25b6-404b-bb2b-db290bcfafa7 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:35.968189 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d18cebff-25b6-404b-bb2b-db290bcfafa7 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:35.969020 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d18cebff-25b6-404b-bb2b-db290bcfafa7 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:35.969459 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d18cebff-25b6-404b-bb2b-db290bcfafa7 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:36.009345 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3e200941-40b6-4ccc-873a-acaa5c88a30d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:36.018401 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3e200941-40b6-4ccc-873a-acaa5c88a30d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1515 microversion: 2.1 time: 0.182958 Mar 08 19:15:36.018985 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 161/325] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:35 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1515 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:36.137655 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d18cebff-25b6-404b-bb2b-db290bcfafa7 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:36.145823 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d18cebff-25b6-404b-bb2b-db290bcfafa7 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1317 microversion: 2.1 time: 0.192032 Mar 08 19:15:36.146394 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 165/326] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:35 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1317 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:37.163729 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8b8b7b21-1c23-49fb-bc1e-8a0028026558 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:37.164904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8b8b7b21-1c23-49fb-bc1e-8a0028026558 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:37.172204 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8b8b7b21-1c23-49fb-bc1e-8a0028026558 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:37.172657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8b8b7b21-1c23-49fb-bc1e-8a0028026558 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:37.174763 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8b8b7b21-1c23-49fb-bc1e-8a0028026558 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:37.175404 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8b8b7b21-1c23-49fb-bc1e-8a0028026558 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:37.314983 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8b8b7b21-1c23-49fb-bc1e-8a0028026558 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:37.322877 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8b8b7b21-1c23-49fb-bc1e-8a0028026558 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1317 microversion: 2.1 time: 0.163969 Mar 08 19:15:37.323448 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 162/327] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:37 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:38.343247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2add6a9d-b272-45f0-bea7-c361fb99b846 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:38.345484 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2add6a9d-b272-45f0-bea7-c361fb99b846 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:38.351859 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2add6a9d-b272-45f0-bea7-c361fb99b846 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:38.357116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2add6a9d-b272-45f0-bea7-c361fb99b846 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:38.358653 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2add6a9d-b272-45f0-bea7-c361fb99b846 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:38.361652 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2add6a9d-b272-45f0-bea7-c361fb99b846 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:38.511940 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2add6a9d-b272-45f0-bea7-c361fb99b846 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:38.520193 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2add6a9d-b272-45f0-bea7-c361fb99b846 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1317 microversion: 2.1 time: 0.181543 Mar 08 19:15:38.520982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 166/328] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:38 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:38.693448 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-43380b60-0a57-458b-98f0-d263ea4a856b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:38.694094 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-43380b60-0a57-458b-98f0-d263ea4a856b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:38.703783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43380b60-0a57-458b-98f0-d263ea4a856b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:38.704433 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43380b60-0a57-458b-98f0-d263ea4a856b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:38.705221 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43380b60-0a57-458b-98f0-d263ea4a856b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:38.705654 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43380b60-0a57-458b-98f0-d263ea4a856b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:38.854085 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-43380b60-0a57-458b-98f0-d263ea4a856b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:38.862609 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-43380b60-0a57-458b-98f0-d263ea4a856b tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1515 microversion: 2.1 time: 0.173043 Mar 08 19:15:38.863181 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 163/329] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:38 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:38.880041 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e41f6b44-bfa7-4635-8f27-1e05077b1117 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fe72da7-d06d-4d42-8e91-58da815690c5"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:38.881162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e41f6b44-bfa7-4635-8f27-1e05077b1117 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:38.889148 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e41f6b44-bfa7-4635-8f27-1e05077b1117 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:38.889602 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e41f6b44-bfa7-4635-8f27-1e05077b1117 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:38.890373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e41f6b44-bfa7-4635-8f27-1e05077b1117 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:38.890813 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e41f6b44-bfa7-4635-8f27-1e05077b1117 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:39.537411 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-aa2f9697-8fc8-4752-b517-2d16a0985a88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:39.538945 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-aa2f9697-8fc8-4752-b517-2d16a0985a88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:39.548442 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa2f9697-8fc8-4752-b517-2d16a0985a88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:39.548895 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa2f9697-8fc8-4752-b517-2d16a0985a88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:39.549661 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa2f9697-8fc8-4752-b517-2d16a0985a88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:39.551706 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa2f9697-8fc8-4752-b517-2d16a0985a88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:39.761751 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e41f6b44-bfa7-4635-8f27-1e05077b1117 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.885915 Mar 08 19:15:39.762778 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 167/330] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:15:38 2022] POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:15:39.777600 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-aa2f9697-8fc8-4752-b517-2d16a0985a88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:39.789746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-aa2f9697-8fc8-4752-b517-2d16a0985a88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1317 microversion: 2.1 time: 0.255833 Mar 08 19:15:39.790302 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 164/331] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:39 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:40.808438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a8f29b66-93d3-48f2-a63f-131504114a4e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:40.809014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a8f29b66-93d3-48f2-a63f-131504114a4e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:40.815181 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8f29b66-93d3-48f2-a63f-131504114a4e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:40.815708 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8f29b66-93d3-48f2-a63f-131504114a4e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:40.816923 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8f29b66-93d3-48f2-a63f-131504114a4e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:40.817014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8f29b66-93d3-48f2-a63f-131504114a4e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:40.967512 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a8f29b66-93d3-48f2-a63f-131504114a4e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:40.975535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a8f29b66-93d3-48f2-a63f-131504114a4e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1317 microversion: 2.1 time: 0.172445 Mar 08 19:15:40.976156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 168/332] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:40 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:41.628946 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-c71007d0-8588-4364-a3f5-b8e63b726be9 req-8195745c-78f1-4bb8-ab8a-2814714c3080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bb0f82-aeaa-42b9-b40a-c5217b7a2115", "name": "network-vif-plugged", "status": "completed", "tag": "72fb0b49-ef73-4842-996c-d54211ee6abb"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:41.636799 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-c71007d0-8588-4364-a3f5-b8e63b726be9 req-8195745c-78f1-4bb8-ab8a-2814714c3080 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:41.637504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-c71007d0-8588-4364-a3f5-b8e63b726be9 req-8195745c-78f1-4bb8-ab8a-2814714c3080 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:41.649595 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-c71007d0-8588-4364-a3f5-b8e63b726be9 req-8195745c-78f1-4bb8-ab8a-2814714c3080 service nova] Creating event network-vif-plugged:72fb0b49-ef73-4842-996c-d54211ee6abb for instance 34bb0f82-aeaa-42b9-b40a-c5217b7a2115 on hv-cinder-83009 Mar 08 19:15:41.663697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-c71007d0-8588-4364-a3f5-b8e63b726be9 req-8195745c-78f1-4bb8-ab8a-2814714c3080 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038907 Mar 08 19:15:41.664330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 165/333] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:15:41.993744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c54080c8-583b-4e0b-9a24-87d249b54727 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:41.994463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c54080c8-583b-4e0b-9a24-87d249b54727 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:42.001101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c54080c8-583b-4e0b-9a24-87d249b54727 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:42.001545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c54080c8-583b-4e0b-9a24-87d249b54727 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:42.002319 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c54080c8-583b-4e0b-9a24-87d249b54727 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:42.002947 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c54080c8-583b-4e0b-9a24-87d249b54727 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:42.450668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c54080c8-583b-4e0b-9a24-87d249b54727 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:42.462918 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c54080c8-583b-4e0b-9a24-87d249b54727 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1317 microversion: 2.1 time: 0.473285 Mar 08 19:15:42.464017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 169/334] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:41 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:43.488540 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8ae548bf-c7fa-40af-bbc5-17f671598ba5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:43.488540 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8ae548bf-c7fa-40af-bbc5-17f671598ba5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:43.494372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8ae548bf-c7fa-40af-bbc5-17f671598ba5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:43.494825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8ae548bf-c7fa-40af-bbc5-17f671598ba5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:43.495595 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8ae548bf-c7fa-40af-bbc5-17f671598ba5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:43.496062 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8ae548bf-c7fa-40af-bbc5-17f671598ba5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:43.629497 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8ae548bf-c7fa-40af-bbc5-17f671598ba5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:43.636933 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8ae548bf-c7fa-40af-bbc5-17f671598ba5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1317 microversion: 2.1 time: 0.154270 Mar 08 19:15:43.637748 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 166/335] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:43 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:44.506839 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1155931845", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "networks": [{"uuid": "1a068db2-6dfe-4657-8fb2-218599d890d9"}]}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:44.566108 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] validate_networks() for [('1a068db2-6dfe-4657-8fb2-218599d890d9', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:15:44.657997 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8f14363c-709f-4365-ada1-5f5a77eaf1d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:44.658684 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8f14363c-709f-4365-ada1-5f5a77eaf1d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:44.664872 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8f14363c-709f-4365-ada1-5f5a77eaf1d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:44.665327 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8f14363c-709f-4365-ada1-5f5a77eaf1d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:44.666107 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8f14363c-709f-4365-ada1-5f5a77eaf1d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:44.666544 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8f14363c-709f-4365-ada1-5f5a77eaf1d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:44.926040 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8f14363c-709f-4365-ada1-5f5a77eaf1d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:44.935738 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8f14363c-709f-4365-ada1-5f5a77eaf1d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1507 microversion: 2.1 time: 0.281736 Mar 08 19:15:44.937036 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 167/336] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:44 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1507 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:15:44.998484 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:15:44.998903 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:15:44.999381 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:15:44.999773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:15:45.000217 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:15:45.009636 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:45.010075 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:45.010907 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:45.011298 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:45.028501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Getting quotas for project bdba71d13754424b826f9fb2b1ab5e6b. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:15:45.032374 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Getting quotas for user 98ec93c5dfaa4e6da92f6f86fce02e2c and project bdba71d13754424b826f9fb2b1ab5e6b. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:15:45.044304 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:15:45.046738 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:15:45.189266 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e11bfa1f-501d-487d-98a0-5c7c3d302f44 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687078 Mar 08 19:15:45.190110 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 170/337] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:15:45.200746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-335e0fcb-634b-4935-abee-e7cbcd39b91b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:45.201397 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-335e0fcb-634b-4935-abee-e7cbcd39b91b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:45.253486 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-335e0fcb-634b-4935-abee-e7cbcd39b91b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:45.260858 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-335e0fcb-634b-4935-abee-e7cbcd39b91b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1214 microversion: 2.1 time: 0.064099 Mar 08 19:15:45.261414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 168/338] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:45 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:46.279096 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1e1ffc12-6b45-4f31-bf09-dc120501b1c4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:46.279703 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1e1ffc12-6b45-4f31-bf09-dc120501b1c4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:46.285545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc12-6b45-4f31-bf09-dc120501b1c4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:46.286701 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc12-6b45-4f31-bf09-dc120501b1c4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:46.287462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc12-6b45-4f31-bf09-dc120501b1c4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:46.287893 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e1ffc12-6b45-4f31-bf09-dc120501b1c4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:46.350571 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1e1ffc12-6b45-4f31-bf09-dc120501b1c4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:46.358066 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1e1ffc12-6b45-4f31-bf09-dc120501b1c4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1218 microversion: 2.1 time: 0.083267 Mar 08 19:15:46.358633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 171/339] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:46 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:47.374979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ae6a06da-43f9-432a-880c-593b4e67ebff tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:47.375585 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ae6a06da-43f9-432a-880c-593b4e67ebff tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:47.383615 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ae6a06da-43f9-432a-880c-593b4e67ebff tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:47.384095 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ae6a06da-43f9-432a-880c-593b4e67ebff tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:47.384878 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ae6a06da-43f9-432a-880c-593b4e67ebff tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:47.385402 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ae6a06da-43f9-432a-880c-593b4e67ebff tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:47.448097 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ae6a06da-43f9-432a-880c-593b4e67ebff tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:47.455589 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ae6a06da-43f9-432a-880c-593b4e67ebff tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1210 microversion: 2.1 time: 0.084478 Mar 08 19:15:47.456183 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 169/340] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:47 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:48.363689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-bca605b1-d22e-4fc8-ade0-411c849ca3d5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:48.364825 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-bca605b1-d22e-4fc8-ade0-411c849ca3d5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:48.383864 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bca605b1-d22e-4fc8-ade0-411c849ca3d5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:48.384373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bca605b1-d22e-4fc8-ade0-411c849ca3d5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:48.385168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bca605b1-d22e-4fc8-ade0-411c849ca3d5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:48.385617 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bca605b1-d22e-4fc8-ade0-411c849ca3d5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:48.413641 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-bca605b1-d22e-4fc8-ade0-411c849ca3d5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lazy-loading 'flavor' on Instance uuid 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:15:48.474064 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-73255a59-fe13-4dd2-a4b6-1118696378b0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:48.474845 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-73255a59-fe13-4dd2-a4b6-1118696378b0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:48.481628 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-73255a59-fe13-4dd2-a4b6-1118696378b0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:48.482366 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-73255a59-fe13-4dd2-a4b6-1118696378b0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:48.483555 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-73255a59-fe13-4dd2-a4b6-1118696378b0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:48.484294 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-73255a59-fe13-4dd2-a4b6-1118696378b0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:48.564806 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-73255a59-fe13-4dd2-a4b6-1118696378b0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:48.573394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-73255a59-fe13-4dd2-a4b6-1118696378b0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1284 microversion: 2.1 time: 0.103955 Mar 08 19:15:48.574208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 170/341] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:48 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:15:48.844416 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-bca605b1-d22e-4fc8-ade0-411c849ca3d5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/action" status: 200 len: 32 microversion: 2.1 time: 0.485410 Mar 08 19:15:48.845158 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 172/342] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:15:48 2022] POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/action => generated 32 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:15:48.857322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8016e4ea-4892-4441-964a-1d7cbf48b06a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:48.858414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8016e4ea-4892-4441-964a-1d7cbf48b06a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:48.866771 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8016e4ea-4892-4441-964a-1d7cbf48b06a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:48.867867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8016e4ea-4892-4441-964a-1d7cbf48b06a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:48.868979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8016e4ea-4892-4441-964a-1d7cbf48b06a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:48.869414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8016e4ea-4892-4441-964a-1d7cbf48b06a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:49.145896 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8016e4ea-4892-4441-964a-1d7cbf48b06a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:49.156169 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8016e4ea-4892-4441-964a-1d7cbf48b06a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.303879 Mar 08 19:15:49.157490 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 171/343] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:48 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:49.591774 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-193e0b98-2581-4808-8402-5577d4274870 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:49.599619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-193e0b98-2581-4808-8402-5577d4274870 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:49.610099 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-193e0b98-2581-4808-8402-5577d4274870 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:49.610553 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-193e0b98-2581-4808-8402-5577d4274870 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:49.618368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-193e0b98-2581-4808-8402-5577d4274870 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:49.618368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-193e0b98-2581-4808-8402-5577d4274870 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:50.023545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-193e0b98-2581-4808-8402-5577d4274870 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:50.031864 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-193e0b98-2581-4808-8402-5577d4274870 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.444389 Mar 08 19:15:50.043080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 173/344] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:49 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:50.174735 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-caad3b2d-fc4c-4537-9f49-9eedd39b515a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:50.175343 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-caad3b2d-fc4c-4537-9f49-9eedd39b515a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:50.181674 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-caad3b2d-fc4c-4537-9f49-9eedd39b515a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:50.182147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-caad3b2d-fc4c-4537-9f49-9eedd39b515a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:50.182951 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-caad3b2d-fc4c-4537-9f49-9eedd39b515a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:50.183428 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-caad3b2d-fc4c-4537-9f49-9eedd39b515a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:50.375109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-caad3b2d-fc4c-4537-9f49-9eedd39b515a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:50.390685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-caad3b2d-fc4c-4537-9f49-9eedd39b515a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.219521 Mar 08 19:15:50.391265 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 172/345] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:50 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:50.696915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-d8637e17-7ff4-4c50-876c-60a605c9bbff req-32d8f629-ff1e-46ca-a1b3-bfe21e963cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ff5f67-64a1-4704-9302-bc3ac7bedb4f", "tag": "aeda3f8a-c7bf-4641-af52-b5fd45f03c3b"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:50.707427 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-d8637e17-7ff4-4c50-876c-60a605c9bbff req-32d8f629-ff1e-46ca-a1b3-bfe21e963cff service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:50.708124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-d8637e17-7ff4-4c50-876c-60a605c9bbff req-32d8f629-ff1e-46ca-a1b3-bfe21e963cff service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:50.720289 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-d8637e17-7ff4-4c50-876c-60a605c9bbff req-32d8f629-ff1e-46ca-a1b3-bfe21e963cff service nova] Creating event network-changed:aeda3f8a-c7bf-4641-af52-b5fd45f03c3b for instance d6ff5f67-64a1-4704-9302-bc3ac7bedb4f on hv-cinder-83009 Mar 08 19:15:50.725464 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-d8637e17-7ff4-4c50-876c-60a605c9bbff req-32d8f629-ff1e-46ca-a1b3-bfe21e963cff service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033497 Mar 08 19:15:50.726609 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 174/346] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:15:51.054090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4488f5da-d318-4b44-a943-c409585fa803 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:51.054733 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4488f5da-d318-4b44-a943-c409585fa803 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:51.060568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4488f5da-d318-4b44-a943-c409585fa803 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:51.061017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4488f5da-d318-4b44-a943-c409585fa803 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:51.061915 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4488f5da-d318-4b44-a943-c409585fa803 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:51.062363 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4488f5da-d318-4b44-a943-c409585fa803 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:51.289040 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4488f5da-d318-4b44-a943-c409585fa803 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:51.296811 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4488f5da-d318-4b44-a943-c409585fa803 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.247506 Mar 08 19:15:51.306381 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 173/347] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:51 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:51.409876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cdfc9bcd-0408-4439-b7c0-b6b31fb09c5d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:51.413516 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cdfc9bcd-0408-4439-b7c0-b6b31fb09c5d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:51.417491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cdfc9bcd-0408-4439-b7c0-b6b31fb09c5d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:51.417945 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cdfc9bcd-0408-4439-b7c0-b6b31fb09c5d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:51.418762 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cdfc9bcd-0408-4439-b7c0-b6b31fb09c5d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:51.419202 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cdfc9bcd-0408-4439-b7c0-b6b31fb09c5d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:51.864608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cdfc9bcd-0408-4439-b7c0-b6b31fb09c5d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:51.873064 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cdfc9bcd-0408-4439-b7c0-b6b31fb09c5d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.467425 Mar 08 19:15:51.873649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 175/348] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:51 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:52.314065 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-64042e71-3093-4564-b28b-d6a034b36ace tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:52.314667 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-64042e71-3093-4564-b28b-d6a034b36ace tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:52.321658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64042e71-3093-4564-b28b-d6a034b36ace tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:52.322142 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64042e71-3093-4564-b28b-d6a034b36ace tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:52.322958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64042e71-3093-4564-b28b-d6a034b36ace tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:52.323389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64042e71-3093-4564-b28b-d6a034b36ace tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:52.464101 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-64042e71-3093-4564-b28b-d6a034b36ace tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:52.472390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-64042e71-3093-4564-b28b-d6a034b36ace tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.162125 Mar 08 19:15:52.473009 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 174/349] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:52 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:52.891692 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6d78ca8d-d0b6-4e79-9806-dd3c119a9bfd tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:52.892474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6d78ca8d-d0b6-4e79-9806-dd3c119a9bfd tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:52.899297 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6d78ca8d-d0b6-4e79-9806-dd3c119a9bfd tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:52.899771 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6d78ca8d-d0b6-4e79-9806-dd3c119a9bfd tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:52.906218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6d78ca8d-d0b6-4e79-9806-dd3c119a9bfd tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:52.906218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6d78ca8d-d0b6-4e79-9806-dd3c119a9bfd tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:53.043777 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6d78ca8d-d0b6-4e79-9806-dd3c119a9bfd tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:53.053464 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6d78ca8d-d0b6-4e79-9806-dd3c119a9bfd tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.165620 Mar 08 19:15:53.054412 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 176/350] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:52 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:53.489831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bc0a33b3-f7bf-4ef1-bc6f-3a067a807217 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:53.490543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-bc0a33b3-f7bf-4ef1-bc6f-3a067a807217 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:53.496589 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bc0a33b3-f7bf-4ef1-bc6f-3a067a807217 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:53.497027 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bc0a33b3-f7bf-4ef1-bc6f-3a067a807217 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:53.497778 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bc0a33b3-f7bf-4ef1-bc6f-3a067a807217 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:53.498298 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bc0a33b3-f7bf-4ef1-bc6f-3a067a807217 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:53.637781 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-bc0a33b3-f7bf-4ef1-bc6f-3a067a807217 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:53.645753 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bc0a33b3-f7bf-4ef1-bc6f-3a067a807217 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.160265 Mar 08 19:15:53.646329 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 175/351] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:53 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:54.070995 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b3c472e0-dcfd-4cf0-aee9-ade271f3b089 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:54.071593 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b3c472e0-dcfd-4cf0-aee9-ade271f3b089 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:54.077813 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3c472e0-dcfd-4cf0-aee9-ade271f3b089 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:54.078254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3c472e0-dcfd-4cf0-aee9-ade271f3b089 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:54.079004 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3c472e0-dcfd-4cf0-aee9-ade271f3b089 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:54.079433 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3c472e0-dcfd-4cf0-aee9-ade271f3b089 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:54.215098 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b3c472e0-dcfd-4cf0-aee9-ade271f3b089 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:54.222919 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b3c472e0-dcfd-4cf0-aee9-ade271f3b089 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.156039 Mar 08 19:15:54.223524 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 177/352] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:54 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:54.664057 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7fb7f6a4-e9d7-4641-ba86-7a4e43b42299 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:54.664639 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7fb7f6a4-e9d7-4641-ba86-7a4e43b42299 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:54.672126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7fb7f6a4-e9d7-4641-ba86-7a4e43b42299 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:54.672576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7fb7f6a4-e9d7-4641-ba86-7a4e43b42299 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:54.673362 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7fb7f6a4-e9d7-4641-ba86-7a4e43b42299 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:54.673798 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7fb7f6a4-e9d7-4641-ba86-7a4e43b42299 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:54.807556 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7fb7f6a4-e9d7-4641-ba86-7a4e43b42299 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:54.814767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7fb7f6a4-e9d7-4641-ba86-7a4e43b42299 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.155902 Mar 08 19:15:54.815333 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 176/353] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:54 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:55.240543 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fd628a76-dd42-42cd-a220-42cbf9b2238f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:55.241209 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fd628a76-dd42-42cd-a220-42cbf9b2238f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:55.247745 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd628a76-dd42-42cd-a220-42cbf9b2238f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:55.248228 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd628a76-dd42-42cd-a220-42cbf9b2238f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:55.249047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd628a76-dd42-42cd-a220-42cbf9b2238f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:55.249504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fd628a76-dd42-42cd-a220-42cbf9b2238f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:55.387273 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fd628a76-dd42-42cd-a220-42cbf9b2238f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:55.395188 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fd628a76-dd42-42cd-a220-42cbf9b2238f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.158650 Mar 08 19:15:55.395984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 178/354] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:55 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:55.832958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-754f9b04-6f3b-4df4-b7de-c3564b0edaf4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:55.833590 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-754f9b04-6f3b-4df4-b7de-c3564b0edaf4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:55.840229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-754f9b04-6f3b-4df4-b7de-c3564b0edaf4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:55.840714 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-754f9b04-6f3b-4df4-b7de-c3564b0edaf4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:55.841633 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-754f9b04-6f3b-4df4-b7de-c3564b0edaf4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:55.842075 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-754f9b04-6f3b-4df4-b7de-c3564b0edaf4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:55.984493 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-754f9b04-6f3b-4df4-b7de-c3564b0edaf4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:55.993383 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-754f9b04-6f3b-4df4-b7de-c3564b0edaf4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.164182 Mar 08 19:15:55.993965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 177/355] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:55 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:56.415184 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3d68a5c3-21f6-4264-acc1-c7a631ed4e54 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:56.416086 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3d68a5c3-21f6-4264-acc1-c7a631ed4e54 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:56.428515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3d68a5c3-21f6-4264-acc1-c7a631ed4e54 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:56.428981 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3d68a5c3-21f6-4264-acc1-c7a631ed4e54 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:56.429988 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3d68a5c3-21f6-4264-acc1-c7a631ed4e54 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:56.430551 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3d68a5c3-21f6-4264-acc1-c7a631ed4e54 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:56.601245 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3d68a5c3-21f6-4264-acc1-c7a631ed4e54 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:56.609645 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3d68a5c3-21f6-4264-acc1-c7a631ed4e54 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.199076 Mar 08 19:15:56.610291 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 179/356] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:56 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:57.011657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-31324591-a6ac-4318-a04f-69473bdf5704 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:57.012695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-31324591-a6ac-4318-a04f-69473bdf5704 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:57.026248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-31324591-a6ac-4318-a04f-69473bdf5704 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:57.026248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-31324591-a6ac-4318-a04f-69473bdf5704 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:57.026248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-31324591-a6ac-4318-a04f-69473bdf5704 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:57.026248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-31324591-a6ac-4318-a04f-69473bdf5704 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:57.177450 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-31324591-a6ac-4318-a04f-69473bdf5704 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:57.186423 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-31324591-a6ac-4318-a04f-69473bdf5704 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.178696 Mar 08 19:15:57.186982 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 178/357] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:57 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:57.631685 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-aeec4263-7e9b-413a-b0e9-de436587a6b9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:57.634133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-aeec4263-7e9b-413a-b0e9-de436587a6b9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:57.641425 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aeec4263-7e9b-413a-b0e9-de436587a6b9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:57.641874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aeec4263-7e9b-413a-b0e9-de436587a6b9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:57.642874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aeec4263-7e9b-413a-b0e9-de436587a6b9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:57.643310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aeec4263-7e9b-413a-b0e9-de436587a6b9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:57.782566 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-aeec4263-7e9b-413a-b0e9-de436587a6b9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:57.790453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-aeec4263-7e9b-413a-b0e9-de436587a6b9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.165086 Mar 08 19:15:57.791014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 180/358] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:57 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:58.204026 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3cbea2ba-185a-4634-b60f-bfb42c9a0f4e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:58.204631 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3cbea2ba-185a-4634-b60f-bfb42c9a0f4e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:58.210782 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3cbea2ba-185a-4634-b60f-bfb42c9a0f4e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:58.211232 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3cbea2ba-185a-4634-b60f-bfb42c9a0f4e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:58.212045 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3cbea2ba-185a-4634-b60f-bfb42c9a0f4e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:58.212489 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3cbea2ba-185a-4634-b60f-bfb42c9a0f4e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:58.354943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3cbea2ba-185a-4634-b60f-bfb42c9a0f4e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:58.362329 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3cbea2ba-185a-4634-b60f-bfb42c9a0f4e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.162201 Mar 08 19:15:58.362902 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 179/359] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:58 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:58.807552 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e7ef799b-33ca-48fa-97d6-af65f911f28f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:58.808213 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e7ef799b-33ca-48fa-97d6-af65f911f28f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:58.814473 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e7ef799b-33ca-48fa-97d6-af65f911f28f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:58.814925 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e7ef799b-33ca-48fa-97d6-af65f911f28f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:58.815699 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e7ef799b-33ca-48fa-97d6-af65f911f28f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:58.816171 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e7ef799b-33ca-48fa-97d6-af65f911f28f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:58.962384 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e7ef799b-33ca-48fa-97d6-af65f911f28f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:58.970377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e7ef799b-33ca-48fa-97d6-af65f911f28f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.167260 Mar 08 19:15:58.971045 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 181/360] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:58 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:59.380460 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-35e5b311-a6e9-40c5-bc55-28fdd6975831 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:59.381734 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-35e5b311-a6e9-40c5-bc55-28fdd6975831 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:59.387781 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-35e5b311-a6e9-40c5-bc55-28fdd6975831 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:59.388264 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-35e5b311-a6e9-40c5-bc55-28fdd6975831 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:59.389015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-35e5b311-a6e9-40c5-bc55-28fdd6975831 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:59.389445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-35e5b311-a6e9-40c5-bc55-28fdd6975831 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:59.536303 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-2b7805de-70a8-4899-b0c2-457f90caf565 req-a817ef84-cab1-467b-8dc2-b2644b8284ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ff5f67-64a1-4704-9302-bc3ac7bedb4f", "name": "network-vif-plugged", "status": "completed", "tag": "aeda3f8a-c7bf-4641-af52-b5fd45f03c3b"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:15:59.540650 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-35e5b311-a6e9-40c5-bc55-28fdd6975831 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:15:59.545608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-2b7805de-70a8-4899-b0c2-457f90caf565 req-a817ef84-cab1-467b-8dc2-b2644b8284ae service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:59.546059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-2b7805de-70a8-4899-b0c2-457f90caf565 req-a817ef84-cab1-467b-8dc2-b2644b8284ae service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:59.549198 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-35e5b311-a6e9-40c5-bc55-28fdd6975831 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.172496 Mar 08 19:15:59.549996 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 180/361] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:59 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:15:59.562132 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-2b7805de-70a8-4899-b0c2-457f90caf565 req-a817ef84-cab1-467b-8dc2-b2644b8284ae service nova] Creating event network-vif-plugged:aeda3f8a-c7bf-4641-af52-b5fd45f03c3b for instance d6ff5f67-64a1-4704-9302-bc3ac7bedb4f on hv-cinder-83009 Mar 08 19:15:59.567496 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-2b7805de-70a8-4899-b0c2-457f90caf565 req-a817ef84-cab1-467b-8dc2-b2644b8284ae service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037014 Mar 08 19:15:59.568914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 182/362] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:15:59.988275 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3af31478-9ddb-4494-8177-5f0aa0eb3935 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:15:59.988885 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3af31478-9ddb-4494-8177-5f0aa0eb3935 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:15:59.995366 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3af31478-9ddb-4494-8177-5f0aa0eb3935 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:59.996106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3af31478-9ddb-4494-8177-5f0aa0eb3935 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:15:59.996878 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3af31478-9ddb-4494-8177-5f0aa0eb3935 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:15:59.997314 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3af31478-9ddb-4494-8177-5f0aa0eb3935 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:00.132165 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3af31478-9ddb-4494-8177-5f0aa0eb3935 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:00.140134 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3af31478-9ddb-4494-8177-5f0aa0eb3935 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.155814 Mar 08 19:16:00.140696 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 181/363] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:15:59 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:00.567638 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-849bb7c1-1560-4189-808c-70a8e01a9119 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:00.568326 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-849bb7c1-1560-4189-808c-70a8e01a9119 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:00.574326 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-849bb7c1-1560-4189-808c-70a8e01a9119 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:00.579776 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-849bb7c1-1560-4189-808c-70a8e01a9119 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:00.579776 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-849bb7c1-1560-4189-808c-70a8e01a9119 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:00.579776 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-849bb7c1-1560-4189-808c-70a8e01a9119 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:00.715510 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-849bb7c1-1560-4189-808c-70a8e01a9119 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:00.722830 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-849bb7c1-1560-4189-808c-70a8e01a9119 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.160045 Mar 08 19:16:00.723388 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 183/364] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:00 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:01.157418 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-edcb1812-7374-4b22-8ee4-2441f73d3923 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:01.158150 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-edcb1812-7374-4b22-8ee4-2441f73d3923 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:01.164215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-edcb1812-7374-4b22-8ee4-2441f73d3923 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:01.164667 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-edcb1812-7374-4b22-8ee4-2441f73d3923 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:01.165466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-edcb1812-7374-4b22-8ee4-2441f73d3923 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:01.165903 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-edcb1812-7374-4b22-8ee4-2441f73d3923 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:01.316041 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-edcb1812-7374-4b22-8ee4-2441f73d3923 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:01.324640 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-edcb1812-7374-4b22-8ee4-2441f73d3923 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.171167 Mar 08 19:16:01.325207 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 182/365] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:01 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:01.741650 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b3bf473c-04ed-4d0e-b5aa-6bd43a75e703 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:01.742270 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b3bf473c-04ed-4d0e-b5aa-6bd43a75e703 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:01.748805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3bf473c-04ed-4d0e-b5aa-6bd43a75e703 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:01.749331 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3bf473c-04ed-4d0e-b5aa-6bd43a75e703 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:01.750107 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3bf473c-04ed-4d0e-b5aa-6bd43a75e703 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:01.750546 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3bf473c-04ed-4d0e-b5aa-6bd43a75e703 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:01.917670 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b3bf473c-04ed-4d0e-b5aa-6bd43a75e703 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:01.925506 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b3bf473c-04ed-4d0e-b5aa-6bd43a75e703 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1314 microversion: 2.1 time: 0.189101 Mar 08 19:16:01.926090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 184/366] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:01 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:02.343020 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d466bddc-5eef-42e9-b74d-f362b54f0b60 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:02.343733 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d466bddc-5eef-42e9-b74d-f362b54f0b60 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:02.350408 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d466bddc-5eef-42e9-b74d-f362b54f0b60 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:02.350953 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d466bddc-5eef-42e9-b74d-f362b54f0b60 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:02.351648 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d466bddc-5eef-42e9-b74d-f362b54f0b60 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:02.352120 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d466bddc-5eef-42e9-b74d-f362b54f0b60 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:02.487805 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d466bddc-5eef-42e9-b74d-f362b54f0b60 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:02.496033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d466bddc-5eef-42e9-b74d-f362b54f0b60 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.157008 Mar 08 19:16:02.496590 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 183/367] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:02 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:02.942626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-bae60def-4e3a-4c9a-80f2-17c16fa9e2af tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:02.943907 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-bae60def-4e3a-4c9a-80f2-17c16fa9e2af tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:02.950283 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bae60def-4e3a-4c9a-80f2-17c16fa9e2af tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:02.950732 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bae60def-4e3a-4c9a-80f2-17c16fa9e2af tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:02.951502 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bae60def-4e3a-4c9a-80f2-17c16fa9e2af tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:02.951954 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bae60def-4e3a-4c9a-80f2-17c16fa9e2af tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:03.084447 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bae60def-4e3a-4c9a-80f2-17c16fa9e2af tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:03.100367 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-bae60def-4e3a-4c9a-80f2-17c16fa9e2af tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1497 microversion: 2.1 time: 0.160761 Mar 08 19:16:03.100688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 185/368] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:02 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:03.513207 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3072cbb1-61ce-4757-84c8-6b7c10f92c79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:03.513811 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3072cbb1-61ce-4757-84c8-6b7c10f92c79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:03.520139 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3072cbb1-61ce-4757-84c8-6b7c10f92c79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:03.520596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3072cbb1-61ce-4757-84c8-6b7c10f92c79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:03.534482 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3072cbb1-61ce-4757-84c8-6b7c10f92c79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:03.534482 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3072cbb1-61ce-4757-84c8-6b7c10f92c79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:03.657171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3072cbb1-61ce-4757-84c8-6b7c10f92c79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:03.666030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3072cbb1-61ce-4757-84c8-6b7c10f92c79 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.156948 Mar 08 19:16:03.666608 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 184/369] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:03 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:04.116689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d2b00c32-b7ee-4db6-9063-d4eacd8c6ef6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:04.117175 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d2b00c32-b7ee-4db6-9063-d4eacd8c6ef6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:04.123509 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d2b00c32-b7ee-4db6-9063-d4eacd8c6ef6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:04.124126 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d2b00c32-b7ee-4db6-9063-d4eacd8c6ef6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:04.124749 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d2b00c32-b7ee-4db6-9063-d4eacd8c6ef6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:04.125251 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d2b00c32-b7ee-4db6-9063-d4eacd8c6ef6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:04.150339 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d2b00c32-b7ee-4db6-9063-d4eacd8c6ef6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:16:04.463089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d2b00c32-b7ee-4db6-9063-d4eacd8c6ef6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "DELETE /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 204 len: 0 microversion: 2.1 time: 0.350551 Mar 08 19:16:04.463996 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 186/370] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:16:04 2022] DELETE /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:16:04.472574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c83b4843-4c67-411d-a603-a64deff8a2a5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:04.473127 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c83b4843-4c67-411d-a603-a64deff8a2a5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:04.480407 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c83b4843-4c67-411d-a603-a64deff8a2a5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:04.480855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c83b4843-4c67-411d-a603-a64deff8a2a5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:04.481616 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c83b4843-4c67-411d-a603-a64deff8a2a5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:04.482052 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c83b4843-4c67-411d-a603-a64deff8a2a5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:04.649483 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c83b4843-4c67-411d-a603-a64deff8a2a5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:04.656676 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c83b4843-4c67-411d-a603-a64deff8a2a5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1503 microversion: 2.1 time: 0.188077 Mar 08 19:16:04.657246 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 185/371] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:04 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:04.684611 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fb910edd-cd5c-45c3-9d8e-2a877e61ec84 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:04.685308 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fb910edd-cd5c-45c3-9d8e-2a877e61ec84 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:04.691318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb910edd-cd5c-45c3-9d8e-2a877e61ec84 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:04.691803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb910edd-cd5c-45c3-9d8e-2a877e61ec84 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:04.692625 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb910edd-cd5c-45c3-9d8e-2a877e61ec84 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:04.693103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb910edd-cd5c-45c3-9d8e-2a877e61ec84 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:04.827972 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fb910edd-cd5c-45c3-9d8e-2a877e61ec84 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:04.836139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fb910edd-cd5c-45c3-9d8e-2a877e61ec84 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.155654 Mar 08 19:16:04.836744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 187/372] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:04 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:05.674683 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a1b5f402-2024-4851-a068-ffc42c107eb5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:05.675283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a1b5f402-2024-4851-a068-ffc42c107eb5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:05.681385 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a1b5f402-2024-4851-a068-ffc42c107eb5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:05.681832 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a1b5f402-2024-4851-a068-ffc42c107eb5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:05.682597 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a1b5f402-2024-4851-a068-ffc42c107eb5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:05.683027 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a1b5f402-2024-4851-a068-ffc42c107eb5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:05.831143 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a1b5f402-2024-4851-a068-ffc42c107eb5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:05.839212 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a1b5f402-2024-4851-a068-ffc42c107eb5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1503 microversion: 2.1 time: 0.168711 Mar 08 19:16:05.844333 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 186/373] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:05 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:05.853452 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce744138-84e2-44f1-aad4-944ff10474b1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:05.854154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ce744138-84e2-44f1-aad4-944ff10474b1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:05.860531 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce744138-84e2-44f1-aad4-944ff10474b1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:05.860984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce744138-84e2-44f1-aad4-944ff10474b1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:05.861753 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce744138-84e2-44f1-aad4-944ff10474b1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:05.862191 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce744138-84e2-44f1-aad4-944ff10474b1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:05.997906 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ce744138-84e2-44f1-aad4-944ff10474b1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:06.005872 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ce744138-84e2-44f1-aad4-944ff10474b1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.156985 Mar 08 19:16:06.007767 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 188/374] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:05 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:06.856599 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-22cc366e-e82c-4342-be13-16bc87cd08b9 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:06.857207 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-22cc366e-e82c-4342-be13-16bc87cd08b9 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:06.863173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-22cc366e-e82c-4342-be13-16bc87cd08b9 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:06.863619 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-22cc366e-e82c-4342-be13-16bc87cd08b9 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:06.864414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-22cc366e-e82c-4342-be13-16bc87cd08b9 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:06.864845 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-22cc366e-e82c-4342-be13-16bc87cd08b9 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:07.025003 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-609580e3-d733-4507-a231-f9e0072d9a13 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:07.025608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-609580e3-d733-4507-a231-f9e0072d9a13 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:07.032386 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-609580e3-d733-4507-a231-f9e0072d9a13 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:07.032819 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-609580e3-d733-4507-a231-f9e0072d9a13 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:07.033588 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-609580e3-d733-4507-a231-f9e0072d9a13 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:07.034025 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-609580e3-d733-4507-a231-f9e0072d9a13 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:07.109066 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-22cc366e-e82c-4342-be13-16bc87cd08b9 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:07.116934 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-22cc366e-e82c-4342-be13-16bc87cd08b9 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1503 microversion: 2.1 time: 0.264269 Mar 08 19:16:07.117496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 187/375] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:06 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:07.196572 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-609580e3-d733-4507-a231-f9e0072d9a13 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:07.204526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-609580e3-d733-4507-a231-f9e0072d9a13 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.183964 Mar 08 19:16:07.205497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 189/376] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:07 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:07.292879 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-d0d6cc34-646b-410c-95b2-77842b2da865 req-85af4da9-41aa-4c29-82bf-29eadaa4877c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ff5f67-64a1-4704-9302-bc3ac7bedb4f", "name": "network-vif-deleted", "tag": "aeda3f8a-c7bf-4641-af52-b5fd45f03c3b"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:07.300670 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-d0d6cc34-646b-410c-95b2-77842b2da865 req-85af4da9-41aa-4c29-82bf-29eadaa4877c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:07.301117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-d0d6cc34-646b-410c-95b2-77842b2da865 req-85af4da9-41aa-4c29-82bf-29eadaa4877c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:07.312433 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-d0d6cc34-646b-410c-95b2-77842b2da865 req-85af4da9-41aa-4c29-82bf-29eadaa4877c service nova] Creating event network-vif-deleted:aeda3f8a-c7bf-4641-af52-b5fd45f03c3b for instance d6ff5f67-64a1-4704-9302-bc3ac7bedb4f on hv-cinder-83009 Mar 08 19:16:07.317471 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-d0d6cc34-646b-410c-95b2-77842b2da865 req-85af4da9-41aa-4c29-82bf-29eadaa4877c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028188 Mar 08 19:16:07.318000 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 188/377] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:08.133399 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:08.133968 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:08.140424 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:08.140877 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:08.141650 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:08.142088 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:08.172168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:08.172621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:08.173065 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lazy-loading 'fault' on Instance uuid d6ff5f67-64a1-4704-9302-bc3ac7bedb4f {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:16:08.215274 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:08.222125 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-62d87b40-e993-4efd-ba5a-e3fea2da5717 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:08.222838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-62d87b40-e993-4efd-ba5a-e3fea2da5717 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:08.224448 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-09f770fb-4839-4a0e-a047-0395d31622e4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 200 len: 1304 microversion: 2.1 time: 0.095239 Mar 08 19:16:08.225220 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 190/378] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:08 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:08.232321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-62d87b40-e993-4efd-ba5a-e3fea2da5717 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:08.233133 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-62d87b40-e993-4efd-ba5a-e3fea2da5717 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:08.234531 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-62d87b40-e993-4efd-ba5a-e3fea2da5717 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:08.235325 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-62d87b40-e993-4efd-ba5a-e3fea2da5717 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:08.379154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-62d87b40-e993-4efd-ba5a-e3fea2da5717 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:08.388065 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-62d87b40-e993-4efd-ba5a-e3fea2da5717 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.169967 Mar 08 19:16:08.388563 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 189/379] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:08 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:09.249354 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:09.249953 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: d6ff5f67-64a1-4704-9302-bc3ac7bedb4f] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:09.256762 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:09.257783 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:09.258938 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:09.259377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:09.273464 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] HTTP exception thrown: Instance d6ff5f67-64a1-4704-9302-bc3ac7bedb4f could not be found. Mar 08 19:16:09.274049 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Returning 404 to user: Instance d6ff5f67-64a1-4704-9302-bc3ac7bedb4f could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:16:09.274887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1e0c2802-9b72-4cca-a166-25bcae414ca8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f" status: 404 len: 111 microversion: 2.1 time: 0.029472 Mar 08 19:16:09.275393 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 191/380] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:09 2022] GET /compute/v2.1/servers/d6ff5f67-64a1-4704-9302-bc3ac7bedb4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:16:09.379462 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-883912783", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "networks": [{"uuid": "1a068db2-6dfe-4657-8fb2-218599d890d9"}]}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:09.406619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-99692cf1-7db0-4ab3-aa05-92b843544bd5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:09.407229 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-99692cf1-7db0-4ab3-aa05-92b843544bd5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:09.413089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-99692cf1-7db0-4ab3-aa05-92b843544bd5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:09.414694 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-99692cf1-7db0-4ab3-aa05-92b843544bd5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:09.415490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-99692cf1-7db0-4ab3-aa05-92b843544bd5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:09.415964 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-99692cf1-7db0-4ab3-aa05-92b843544bd5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:09.431045 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] validate_networks() for [('1a068db2-6dfe-4657-8fb2-218599d890d9', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:16:09.659712 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-99692cf1-7db0-4ab3-aa05-92b843544bd5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:09.669471 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-99692cf1-7db0-4ab3-aa05-92b843544bd5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.266632 Mar 08 19:16:09.670057 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 192/381] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:09 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:09.857938 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:16:09.858465 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:16:09.858940 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:16:09.859496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:16:09.859904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:16:09.870403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:09.870960 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:09.871824 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:09.872312 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:09.895260 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Getting quotas for project bdba71d13754424b826f9fb2b1ab5e6b. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:16:09.900673 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Getting quotas for user 98ec93c5dfaa4e6da92f6f86fce02e2c and project bdba71d13754424b826f9fb2b1ab5e6b. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:16:09.911611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:16:09.914233 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:16:10.018192 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fc550e54-f2b9-4632-93f2-eb8297f822bb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642514 Mar 08 19:16:10.018759 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 190/382] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:16:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:16:10.030904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f77d9443-7a1c-42a3-9180-c72541dfa2ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:10.031507 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f77d9443-7a1c-42a3-9180-c72541dfa2ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:10.084649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f77d9443-7a1c-42a3-9180-c72541dfa2ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:10.092487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f77d9443-7a1c-42a3-9180-c72541dfa2ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1213 microversion: 2.1 time: 0.066285 Mar 08 19:16:10.093084 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 193/383] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:10 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:10.686540 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2643d61a-ef01-4a28-956f-c78deb4565e2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:10.687153 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2643d61a-ef01-4a28-956f-c78deb4565e2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:10.693220 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2643d61a-ef01-4a28-956f-c78deb4565e2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:10.693684 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2643d61a-ef01-4a28-956f-c78deb4565e2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:10.694583 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2643d61a-ef01-4a28-956f-c78deb4565e2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:10.695023 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2643d61a-ef01-4a28-956f-c78deb4565e2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:10.827074 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2643d61a-ef01-4a28-956f-c78deb4565e2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:10.834818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2643d61a-ef01-4a28-956f-c78deb4565e2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.152339 Mar 08 19:16:10.836131 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 191/384] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:10 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:11.138915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9db5b3d9-d6e3-4b58-b430-17f234c38136 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c2bdc0f-122d-46df-9005-4547431996c0", "device": "/dev/sdb"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:11.138915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9db5b3d9-d6e3-4b58-b430-17f234c38136 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:11.138915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9db5b3d9-d6e3-4b58-b430-17f234c38136 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:11.138915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9db5b3d9-d6e3-4b58-b430-17f234c38136 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:11.139835 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9db5b3d9-d6e3-4b58-b430-17f234c38136 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:11.139835 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9db5b3d9-d6e3-4b58-b430-17f234c38136 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:11.140033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1a2ffb63-e3de-43da-b415-db4c8f4b00ca tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:11.140033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1a2ffb63-e3de-43da-b415-db4c8f4b00ca tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:11.140033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1a2ffb63-e3de-43da-b415-db4c8f4b00ca tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:11.140033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1a2ffb63-e3de-43da-b415-db4c8f4b00ca tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:11.140366 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1a2ffb63-e3de-43da-b415-db4c8f4b00ca tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:11.140366 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1a2ffb63-e3de-43da-b415-db4c8f4b00ca tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:11.187354 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1a2ffb63-e3de-43da-b415-db4c8f4b00ca tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:11.193014 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1a2ffb63-e3de-43da-b415-db4c8f4b00ca tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1217 microversion: 2.1 time: 0.083259 Mar 08 19:16:11.193572 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 192/385] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:11 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:11.851554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4bc8d1f5-7b5d-424e-8d60-91ef24657a35 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:11.852248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4bc8d1f5-7b5d-424e-8d60-91ef24657a35 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:11.859093 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4bc8d1f5-7b5d-424e-8d60-91ef24657a35 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:11.859527 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4bc8d1f5-7b5d-424e-8d60-91ef24657a35 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:11.860321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4bc8d1f5-7b5d-424e-8d60-91ef24657a35 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:11.860762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4bc8d1f5-7b5d-424e-8d60-91ef24657a35 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:11.969135 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9db5b3d9-d6e3-4b58-b430-17f234c38136 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "POST /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889609 Mar 08 19:16:11.969879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 194/386] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:16:11 2022] POST /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:12.006536 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4bc8d1f5-7b5d-424e-8d60-91ef24657a35 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:12.015453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4bc8d1f5-7b5d-424e-8d60-91ef24657a35 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.167778 Mar 08 19:16:12.016101 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 193/387] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:11 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:12.241879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d3493c14-86fb-4156-8d21-a32fba7a4b89 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:12.241879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d3493c14-86fb-4156-8d21-a32fba7a4b89 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:12.241879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d3493c14-86fb-4156-8d21-a32fba7a4b89 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:12.241879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d3493c14-86fb-4156-8d21-a32fba7a4b89 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:12.243078 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d3493c14-86fb-4156-8d21-a32fba7a4b89 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:12.243078 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d3493c14-86fb-4156-8d21-a32fba7a4b89 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:12.284360 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d3493c14-86fb-4156-8d21-a32fba7a4b89 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:12.291501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d3493c14-86fb-4156-8d21-a32fba7a4b89 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1265 microversion: 2.1 time: 0.084636 Mar 08 19:16:12.292083 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 195/388] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:12 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:13.034417 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5b817c24-e3fb-4d6a-8d50-48410f457cb8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:13.034936 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5b817c24-e3fb-4d6a-8d50-48410f457cb8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:13.041048 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5b817c24-e3fb-4d6a-8d50-48410f457cb8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:13.041501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5b817c24-e3fb-4d6a-8d50-48410f457cb8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:13.042274 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5b817c24-e3fb-4d6a-8d50-48410f457cb8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:13.042890 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5b817c24-e3fb-4d6a-8d50-48410f457cb8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:13.286929 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5b817c24-e3fb-4d6a-8d50-48410f457cb8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:13.295134 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5b817c24-e3fb-4d6a-8d50-48410f457cb8 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.264768 Mar 08 19:16:13.296021 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 194/389] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:13 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:13.312928 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9cee31a8-2486-48f3-bea2-3a248c9eb929 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:13.313816 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9cee31a8-2486-48f3-bea2-3a248c9eb929 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:13.321279 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9cee31a8-2486-48f3-bea2-3a248c9eb929 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:13.321789 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9cee31a8-2486-48f3-bea2-3a248c9eb929 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:13.323001 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9cee31a8-2486-48f3-bea2-3a248c9eb929 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:13.323896 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9cee31a8-2486-48f3-bea2-3a248c9eb929 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:13.387179 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9cee31a8-2486-48f3-bea2-3a248c9eb929 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:13.394449 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9cee31a8-2486-48f3-bea2-3a248c9eb929 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1271 microversion: 2.1 time: 0.085551 Mar 08 19:16:13.395120 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 196/390] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:13 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:14.315788 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-49962684-32d9-4aa7-bb83-c1b7bfaff4a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:14.316437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-49962684-32d9-4aa7-bb83-c1b7bfaff4a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:14.322206 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49962684-32d9-4aa7-bb83-c1b7bfaff4a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:14.322653 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49962684-32d9-4aa7-bb83-c1b7bfaff4a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:14.323423 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49962684-32d9-4aa7-bb83-c1b7bfaff4a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:14.323857 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49962684-32d9-4aa7-bb83-c1b7bfaff4a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:14.412661 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-45716d6f-11e9-40d6-a4c1-2678bfdeed8a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:14.413419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-45716d6f-11e9-40d6-a4c1-2678bfdeed8a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:14.421080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-45716d6f-11e9-40d6-a4c1-2678bfdeed8a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:14.421522 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-45716d6f-11e9-40d6-a4c1-2678bfdeed8a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:14.422606 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-45716d6f-11e9-40d6-a4c1-2678bfdeed8a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:14.423038 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-45716d6f-11e9-40d6-a4c1-2678bfdeed8a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:14.575743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-49962684-32d9-4aa7-bb83-c1b7bfaff4a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:14.583489 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-49962684-32d9-4aa7-bb83-c1b7bfaff4a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1567 microversion: 2.1 time: 0.271518 Mar 08 19:16:14.584089 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 195/391] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:14 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1567 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:14.600701 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-5bd33d1f-7e74-44b6-a432-36829241fe2a req-26f72bf4-ed85-44cb-b5c1-00ed86f28843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12866c93-9680-40b8-980d-3f3ab17a10ec", "tag": "d9ffdfef-bbe5-4d98-a651-286c8a5f64da"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:14.610486 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-5bd33d1f-7e74-44b6-a432-36829241fe2a req-26f72bf4-ed85-44cb-b5c1-00ed86f28843 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:14.610930 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-5bd33d1f-7e74-44b6-a432-36829241fe2a req-26f72bf4-ed85-44cb-b5c1-00ed86f28843 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:14.621830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-5bd33d1f-7e74-44b6-a432-36829241fe2a req-26f72bf4-ed85-44cb-b5c1-00ed86f28843 service nova] Creating event network-changed:d9ffdfef-bbe5-4d98-a651-286c8a5f64da for instance 12866c93-9680-40b8-980d-3f3ab17a10ec on hv-cinder-83009 Mar 08 19:16:14.630346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-45716d6f-11e9-40d6-a4c1-2678bfdeed8a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:14.632626 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-5bd33d1f-7e74-44b6-a432-36829241fe2a req-26f72bf4-ed85-44cb-b5c1-00ed86f28843 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030604 Mar 08 19:16:14.633453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 196/392] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:14.638545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-45716d6f-11e9-40d6-a4c1-2678bfdeed8a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.229926 Mar 08 19:16:14.639100 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 197/393] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:14 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:15.602078 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5fe9eb2f-88e0-49ab-b870-f0183638dd73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:15.602682 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5fe9eb2f-88e0-49ab-b870-f0183638dd73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:15.609825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fe9eb2f-88e0-49ab-b870-f0183638dd73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:15.610272 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fe9eb2f-88e0-49ab-b870-f0183638dd73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:15.611041 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fe9eb2f-88e0-49ab-b870-f0183638dd73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:15.611471 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fe9eb2f-88e0-49ab-b870-f0183638dd73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:15.655862 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9b3a4eb4-0a46-433d-a206-97052c304b0b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:15.656502 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9b3a4eb4-0a46-433d-a206-97052c304b0b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:15.662828 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9b3a4eb4-0a46-433d-a206-97052c304b0b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:15.663275 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9b3a4eb4-0a46-433d-a206-97052c304b0b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:15.664067 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9b3a4eb4-0a46-433d-a206-97052c304b0b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:15.664502 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9b3a4eb4-0a46-433d-a206-97052c304b0b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:15.984807 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9b3a4eb4-0a46-433d-a206-97052c304b0b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:15.991814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5fe9eb2f-88e0-49ab-b870-f0183638dd73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:16.005172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9b3a4eb4-0a46-433d-a206-97052c304b0b tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.339937 Mar 08 19:16:16.005172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 198/394] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:15 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:16.005521 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5fe9eb2f-88e0-49ab-b870-f0183638dd73 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1547 microversion: 2.1 time: 0.403311 Mar 08 19:16:16.005521 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 197/395] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:15 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1547 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:16.018082 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:16.018999 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:16.024469 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:16.024973 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:16.026260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:16.026692 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:16.161480 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] HTTP exception thrown: Cannot 'detach_volume' instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 while it is in vm_state rescued Mar 08 19:16:16.162223 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Returning 409 to user: Cannot 'detach_volume' instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 while it is in vm_state rescued {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:16:16.162939 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-716f1a1b-73b9-4624-8690-00e2ac7d2062 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments/9fe72da7-d06d-4d42-8e91-58da815690c5" status: 409 len: 152 microversion: 2.1 time: 0.148964 Mar 08 19:16:16.163496 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 199/396] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:16:16 2022] DELETE /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments/9fe72da7-d06d-4d42-8e91-58da815690c5 => generated 152 bytes in 150 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 08 19:16:16.172708 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4eebd9c3-1226-4ad1-8ab5-3837e6730f69 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:16.173241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4eebd9c3-1226-4ad1-8ab5-3837e6730f69 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:16.179137 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4eebd9c3-1226-4ad1-8ab5-3837e6730f69 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:16.179526 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4eebd9c3-1226-4ad1-8ab5-3837e6730f69 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:16.180307 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4eebd9c3-1226-4ad1-8ab5-3837e6730f69 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:16.180742 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4eebd9c3-1226-4ad1-8ab5-3837e6730f69 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:16.545067 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4eebd9c3-1226-4ad1-8ab5-3837e6730f69 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/action" status: 202 len: 0 microversion: 2.1 time: 0.376064 Mar 08 19:16:16.545640 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 198/397] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:16:16 2022] POST /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:16:16.553927 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4aec1a6c-2ca0-4b54-9171-dcd4dec24686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:16.558502 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4aec1a6c-2ca0-4b54-9171-dcd4dec24686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:16.565963 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4aec1a6c-2ca0-4b54-9171-dcd4dec24686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:16.566666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4aec1a6c-2ca0-4b54-9171-dcd4dec24686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:16.567214 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4aec1a6c-2ca0-4b54-9171-dcd4dec24686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:16.567773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4aec1a6c-2ca0-4b54-9171-dcd4dec24686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:16.748218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4aec1a6c-2ca0-4b54-9171-dcd4dec24686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:16.756832 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4aec1a6c-2ca0-4b54-9171-dcd4dec24686 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1555 microversion: 2.1 time: 0.206837 Mar 08 19:16:16.757407 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 200/398] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:16 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:17.014645 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6e8f9f04-42b2-40d8-8c96-5341d3cb6d5f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:17.015341 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6e8f9f04-42b2-40d8-8c96-5341d3cb6d5f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:17.023300 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e8f9f04-42b2-40d8-8c96-5341d3cb6d5f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:17.023300 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e8f9f04-42b2-40d8-8c96-5341d3cb6d5f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:17.023300 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e8f9f04-42b2-40d8-8c96-5341d3cb6d5f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:17.023792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e8f9f04-42b2-40d8-8c96-5341d3cb6d5f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:17.260965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6e8f9f04-42b2-40d8-8c96-5341d3cb6d5f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:17.269000 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6e8f9f04-42b2-40d8-8c96-5341d3cb6d5f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.259929 Mar 08 19:16:17.269783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 199/399] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:17 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:17.774557 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fac2fae9-22e4-4de7-ba06-4090d3bc790f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:17.775169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fac2fae9-22e4-4de7-ba06-4090d3bc790f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:17.781605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fac2fae9-22e4-4de7-ba06-4090d3bc790f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:17.782056 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fac2fae9-22e4-4de7-ba06-4090d3bc790f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:17.782817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fac2fae9-22e4-4de7-ba06-4090d3bc790f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:17.783259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fac2fae9-22e4-4de7-ba06-4090d3bc790f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:17.938539 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fac2fae9-22e4-4de7-ba06-4090d3bc790f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:17.946278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fac2fae9-22e4-4de7-ba06-4090d3bc790f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1555 microversion: 2.1 time: 0.175583 Mar 08 19:16:17.946839 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 201/400] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:17 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1555 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:18.286655 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4f1be986-76cd-4a9e-a12a-2cb9607ae4f3 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:18.287181 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4f1be986-76cd-4a9e-a12a-2cb9607ae4f3 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:18.293744 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4f1be986-76cd-4a9e-a12a-2cb9607ae4f3 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:18.294197 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4f1be986-76cd-4a9e-a12a-2cb9607ae4f3 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:18.294955 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4f1be986-76cd-4a9e-a12a-2cb9607ae4f3 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:18.295386 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4f1be986-76cd-4a9e-a12a-2cb9607ae4f3 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:18.432028 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4f1be986-76cd-4a9e-a12a-2cb9607ae4f3 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:18.439289 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4f1be986-76cd-4a9e-a12a-2cb9607ae4f3 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.156577 Mar 08 19:16:18.439845 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 200/401] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:18 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:18.963682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6c4c473b-289a-41fa-89cc-3c1b4c08e9cb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:18.964313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6c4c473b-289a-41fa-89cc-3c1b4c08e9cb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:18.970792 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c4c473b-289a-41fa-89cc-3c1b4c08e9cb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:18.971231 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c4c473b-289a-41fa-89cc-3c1b4c08e9cb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:18.972031 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c4c473b-289a-41fa-89cc-3c1b4c08e9cb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:18.972466 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6c4c473b-289a-41fa-89cc-3c1b4c08e9cb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:19.116721 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6c4c473b-289a-41fa-89cc-3c1b4c08e9cb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:19.125425 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6c4c473b-289a-41fa-89cc-3c1b4c08e9cb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1555 microversion: 2.1 time: 0.165723 Mar 08 19:16:19.125994 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 202/402] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:18 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:19.456470 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-07245c89-0f69-4199-b136-2d0a418162a7 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:19.457017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-07245c89-0f69-4199-b136-2d0a418162a7 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:19.462898 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07245c89-0f69-4199-b136-2d0a418162a7 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:19.463360 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07245c89-0f69-4199-b136-2d0a418162a7 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:19.464128 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07245c89-0f69-4199-b136-2d0a418162a7 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:19.464596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07245c89-0f69-4199-b136-2d0a418162a7 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:19.721233 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-07245c89-0f69-4199-b136-2d0a418162a7 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:19.728447 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-07245c89-0f69-4199-b136-2d0a418162a7 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.275857 Mar 08 19:16:19.729000 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 201/403] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:19 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:20.143304 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-226b6c42-d44b-4eeb-97cc-d546893c5810 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:20.143909 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-226b6c42-d44b-4eeb-97cc-d546893c5810 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:20.150224 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-226b6c42-d44b-4eeb-97cc-d546893c5810 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:20.150666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-226b6c42-d44b-4eeb-97cc-d546893c5810 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:20.151419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-226b6c42-d44b-4eeb-97cc-d546893c5810 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:20.151863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-226b6c42-d44b-4eeb-97cc-d546893c5810 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:20.286056 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-226b6c42-d44b-4eeb-97cc-d546893c5810 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:20.294483 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-226b6c42-d44b-4eeb-97cc-d546893c5810 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1555 microversion: 2.1 time: 0.155070 Mar 08 19:16:20.295048 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 203/404] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:20 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:20.745001 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fabf7fcc-fc81-4924-aee2-9bf6188149d4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:20.745602 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fabf7fcc-fc81-4924-aee2-9bf6188149d4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:20.751321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fabf7fcc-fc81-4924-aee2-9bf6188149d4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:20.751764 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fabf7fcc-fc81-4924-aee2-9bf6188149d4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:20.752544 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fabf7fcc-fc81-4924-aee2-9bf6188149d4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:20.753054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fabf7fcc-fc81-4924-aee2-9bf6188149d4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:20.884883 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fabf7fcc-fc81-4924-aee2-9bf6188149d4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:20.893084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fabf7fcc-fc81-4924-aee2-9bf6188149d4 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.151844 Mar 08 19:16:20.893656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 202/405] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:20 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:21.312387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f531e3a3-2a01-4008-9486-e9a722c611eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:21.312995 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f531e3a3-2a01-4008-9486-e9a722c611eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:21.319255 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f531e3a3-2a01-4008-9486-e9a722c611eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:21.319705 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f531e3a3-2a01-4008-9486-e9a722c611eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:21.320510 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f531e3a3-2a01-4008-9486-e9a722c611eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:21.320946 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f531e3a3-2a01-4008-9486-e9a722c611eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:21.460777 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f531e3a3-2a01-4008-9486-e9a722c611eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:21.469467 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f531e3a3-2a01-4008-9486-e9a722c611eb tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1555 microversion: 2.1 time: 0.161599 Mar 08 19:16:21.470157 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 204/406] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:21 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:21.910310 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f5ba2493-0c83-444b-bec2-2c953d28f648 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:21.910909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f5ba2493-0c83-444b-bec2-2c953d28f648 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:21.916728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f5ba2493-0c83-444b-bec2-2c953d28f648 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:21.917168 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f5ba2493-0c83-444b-bec2-2c953d28f648 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:21.917920 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f5ba2493-0c83-444b-bec2-2c953d28f648 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:21.918349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f5ba2493-0c83-444b-bec2-2c953d28f648 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:22.057609 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f5ba2493-0c83-444b-bec2-2c953d28f648 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:22.065812 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f5ba2493-0c83-444b-bec2-2c953d28f648 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.159326 Mar 08 19:16:22.066406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 203/407] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:21 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:22.487311 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fae6850f-aff8-4f7f-85cb-a04a9bb210a1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:22.488060 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fae6850f-aff8-4f7f-85cb-a04a9bb210a1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:22.494337 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fae6850f-aff8-4f7f-85cb-a04a9bb210a1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:22.499346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fae6850f-aff8-4f7f-85cb-a04a9bb210a1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:22.499346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fae6850f-aff8-4f7f-85cb-a04a9bb210a1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:22.499346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fae6850f-aff8-4f7f-85cb-a04a9bb210a1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:22.628702 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fae6850f-aff8-4f7f-85cb-a04a9bb210a1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:22.638439 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fae6850f-aff8-4f7f-85cb-a04a9bb210a1 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1555 microversion: 2.1 time: 0.154610 Mar 08 19:16:22.638998 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 205/408] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:22 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:23.082871 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-64e43972-a597-4097-99c0-3fb0df78b802 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:23.083399 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-64e43972-a597-4097-99c0-3fb0df78b802 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:23.091740 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64e43972-a597-4097-99c0-3fb0df78b802 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:23.092441 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64e43972-a597-4097-99c0-3fb0df78b802 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:23.093587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64e43972-a597-4097-99c0-3fb0df78b802 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:23.094236 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64e43972-a597-4097-99c0-3fb0df78b802 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:23.239712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-64e43972-a597-4097-99c0-3fb0df78b802 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:23.253101 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-64e43972-a597-4097-99c0-3fb0df78b802 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.174063 Mar 08 19:16:23.253693 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 204/409] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:23 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:23.655067 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ae206acd-9b56-4e18-946e-7b12a2e3b4b5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:23.655675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ae206acd-9b56-4e18-946e-7b12a2e3b4b5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:23.662265 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae206acd-9b56-4e18-946e-7b12a2e3b4b5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:23.662719 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae206acd-9b56-4e18-946e-7b12a2e3b4b5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:23.663526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae206acd-9b56-4e18-946e-7b12a2e3b4b5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:23.663986 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae206acd-9b56-4e18-946e-7b12a2e3b4b5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:23.837658 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ae206acd-9b56-4e18-946e-7b12a2e3b4b5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:23.857168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ae206acd-9b56-4e18-946e-7b12a2e3b4b5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1555 microversion: 2.1 time: 0.205732 Mar 08 19:16:23.866555 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 206/410] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:23 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1555 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:24.271125 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3a0e5204-1171-4621-b776-008d7728e28a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:24.271852 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3a0e5204-1171-4621-b776-008d7728e28a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:24.277813 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3a0e5204-1171-4621-b776-008d7728e28a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:24.282359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3a0e5204-1171-4621-b776-008d7728e28a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:24.282359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3a0e5204-1171-4621-b776-008d7728e28a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:24.282359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3a0e5204-1171-4621-b776-008d7728e28a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:24.417875 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3a0e5204-1171-4621-b776-008d7728e28a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:24.427576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3a0e5204-1171-4621-b776-008d7728e28a tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.161111 Mar 08 19:16:24.431568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 205/411] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:24 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:24.873805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2d089ee4-7e0b-416b-9ec7-1f97c7fa7be9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:24.874462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2d089ee4-7e0b-416b-9ec7-1f97c7fa7be9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:24.881134 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d089ee4-7e0b-416b-9ec7-1f97c7fa7be9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:24.881703 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d089ee4-7e0b-416b-9ec7-1f97c7fa7be9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:24.882515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d089ee4-7e0b-416b-9ec7-1f97c7fa7be9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:24.882991 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d089ee4-7e0b-416b-9ec7-1f97c7fa7be9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:25.022239 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2d089ee4-7e0b-416b-9ec7-1f97c7fa7be9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:25.030761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2d089ee4-7e0b-416b-9ec7-1f97c7fa7be9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1555 microversion: 2.1 time: 0.161492 Mar 08 19:16:25.036702 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 207/412] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:24 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:25.449266 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-15de7092-f986-4bab-87a9-d8aac96a67c8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:25.449792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-15de7092-f986-4bab-87a9-d8aac96a67c8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:25.456010 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15de7092-f986-4bab-87a9-d8aac96a67c8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:25.456484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15de7092-f986-4bab-87a9-d8aac96a67c8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:25.457321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15de7092-f986-4bab-87a9-d8aac96a67c8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:25.457750 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15de7092-f986-4bab-87a9-d8aac96a67c8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:25.632287 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-15de7092-f986-4bab-87a9-d8aac96a67c8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:25.640711 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-15de7092-f986-4bab-87a9-d8aac96a67c8 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.195317 Mar 08 19:16:25.641290 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 206/413] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:25 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:26.048868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ffb90d35-71a7-4893-aaf0-efe7bcd1c229 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:26.049459 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ffb90d35-71a7-4893-aaf0-efe7bcd1c229 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:26.056316 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ffb90d35-71a7-4893-aaf0-efe7bcd1c229 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.056764 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ffb90d35-71a7-4893-aaf0-efe7bcd1c229 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.057533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ffb90d35-71a7-4893-aaf0-efe7bcd1c229 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.057965 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ffb90d35-71a7-4893-aaf0-efe7bcd1c229 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.196808 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ffb90d35-71a7-4893-aaf0-efe7bcd1c229 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:26.204912 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ffb90d35-71a7-4893-aaf0-efe7bcd1c229 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1561 microversion: 2.1 time: 0.160034 Mar 08 19:16:26.205492 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 208/414] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:26 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:26.274276 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f0fdc2d6-6880-4d64-aafa-c92556c37360 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:26.274772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f0fdc2d6-6880-4d64-aafa-c92556c37360 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:26.281522 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f0fdc2d6-6880-4d64-aafa-c92556c37360 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.281998 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f0fdc2d6-6880-4d64-aafa-c92556c37360 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.283967 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f0fdc2d6-6880-4d64-aafa-c92556c37360 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.283967 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f0fdc2d6-6880-4d64-aafa-c92556c37360 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.405397 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-f0fdc2d6-6880-4d64-aafa-c92556c37360 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lazy-loading 'services' on Instance uuid 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:16:26.637959 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f0fdc2d6-6880-4d64-aafa-c92556c37360 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments/9fe72da7-d06d-4d42-8e91-58da815690c5" status: 202 len: 0 microversion: 2.1 time: 0.367402 Mar 08 19:16:26.638715 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 207/415] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:16:26 2022] DELETE /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments/9fe72da7-d06d-4d42-8e91-58da815690c5 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:16:26.647291 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-919cb3dc-f49b-42aa-8d4a-988a279c65c3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:26.648446 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-919cb3dc-f49b-42aa-8d4a-988a279c65c3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:26.656279 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-919cb3dc-f49b-42aa-8d4a-988a279c65c3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.664338 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-919cb3dc-f49b-42aa-8d4a-988a279c65c3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.664338 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-919cb3dc-f49b-42aa-8d4a-988a279c65c3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.664338 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-919cb3dc-f49b-42aa-8d4a-988a279c65c3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.664653 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1617f60c-6745-45a4-8d34-f3fb72d5436e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:26.664653 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1617f60c-6745-45a4-8d34-f3fb72d5436e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:26.665661 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1617f60c-6745-45a4-8d34-f3fb72d5436e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.666285 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1617f60c-6745-45a4-8d34-f3fb72d5436e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.667270 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1617f60c-6745-45a4-8d34-f3fb72d5436e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.667907 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1617f60c-6745-45a4-8d34-f3fb72d5436e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.689598 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-919cb3dc-f49b-42aa-8d4a-988a279c65c3 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Mar 08 19:16:26.690170 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 209/416] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:16:26 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:26.818884 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1617f60c-6745-45a4-8d34-f3fb72d5436e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:26.828651 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1617f60c-6745-45a4-8d34-f3fb72d5436e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.174328 Mar 08 19:16:26.829383 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 208/417] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:26 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:26.898373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-d5197d54-b8b0-4939-b8a4-7c23f9f2eb56 req-866ee3b9-d34e-430f-a90c-93af38f111a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12866c93-9680-40b8-980d-3f3ab17a10ec", "name": "network-vif-plugged", "status": "completed", "tag": "d9ffdfef-bbe5-4d98-a651-286c8a5f64da"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:26.906572 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-d5197d54-b8b0-4939-b8a4-7c23f9f2eb56 req-866ee3b9-d34e-430f-a90c-93af38f111a9 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:26.907018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-d5197d54-b8b0-4939-b8a4-7c23f9f2eb56 req-866ee3b9-d34e-430f-a90c-93af38f111a9 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:26.917501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-d5197d54-b8b0-4939-b8a4-7c23f9f2eb56 req-866ee3b9-d34e-430f-a90c-93af38f111a9 service nova] Creating event network-vif-plugged:d9ffdfef-bbe5-4d98-a651-286c8a5f64da for instance 12866c93-9680-40b8-980d-3f3ab17a10ec on hv-cinder-83009 Mar 08 19:16:26.923674 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-d5197d54-b8b0-4939-b8a4-7c23f9f2eb56 req-866ee3b9-d34e-430f-a90c-93af38f111a9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028872 Mar 08 19:16:26.924472 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 210/418] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:27.701488 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f3b1091f-5289-471e-a386-5c5b1274e527 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:27.702423 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f3b1091f-5289-471e-a386-5c5b1274e527 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:27.708304 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f3b1091f-5289-471e-a386-5c5b1274e527 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:27.708750 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f3b1091f-5289-471e-a386-5c5b1274e527 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:27.709510 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f3b1091f-5289-471e-a386-5c5b1274e527 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:27.710002 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f3b1091f-5289-471e-a386-5c5b1274e527 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:27.739595 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f3b1091f-5289-471e-a386-5c5b1274e527 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042975 Mar 08 19:16:27.740177 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 209/419] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:16:27 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:27.850486 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9772c2d3-0751-4cb1-b826-f3a7560c77f6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:27.851174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9772c2d3-0751-4cb1-b826-f3a7560c77f6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:27.858105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9772c2d3-0751-4cb1-b826-f3a7560c77f6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:27.858546 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9772c2d3-0751-4cb1-b826-f3a7560c77f6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:27.859398 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9772c2d3-0751-4cb1-b826-f3a7560c77f6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:27.859827 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9772c2d3-0751-4cb1-b826-f3a7560c77f6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:27.992854 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9772c2d3-0751-4cb1-b826-f3a7560c77f6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:28.000138 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9772c2d3-0751-4cb1-b826-f3a7560c77f6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.154223 Mar 08 19:16:28.000696 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 211/420] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:27 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:28.751755 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b95cea6e-9f24-4179-8e23-14238c31cbec tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:28.752726 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b95cea6e-9f24-4179-8e23-14238c31cbec tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:28.758781 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b95cea6e-9f24-4179-8e23-14238c31cbec tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:28.759224 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b95cea6e-9f24-4179-8e23-14238c31cbec tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:28.760017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b95cea6e-9f24-4179-8e23-14238c31cbec tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:28.760452 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b95cea6e-9f24-4179-8e23-14238c31cbec tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:28.789989 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b95cea6e-9f24-4179-8e23-14238c31cbec tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042915 Mar 08 19:16:28.790542 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 210/421] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:16:28 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:29.017619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8c9168e5-3ec3-4439-b237-3cc5b185a888 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:29.018172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8c9168e5-3ec3-4439-b237-3cc5b185a888 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:29.024508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8c9168e5-3ec3-4439-b237-3cc5b185a888 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:29.025315 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8c9168e5-3ec3-4439-b237-3cc5b185a888 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:29.025903 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8c9168e5-3ec3-4439-b237-3cc5b185a888 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:29.026335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8c9168e5-3ec3-4439-b237-3cc5b185a888 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:29.163450 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8c9168e5-3ec3-4439-b237-3cc5b185a888 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:29.171267 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8c9168e5-3ec3-4439-b237-3cc5b185a888 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.157771 Mar 08 19:16:29.171887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 212/422] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:29 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:29.802949 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3f335474-d648-4b23-9ad7-0f48f654aaf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:29.803978 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3f335474-d648-4b23-9ad7-0f48f654aaf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:29.810919 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3f335474-d648-4b23-9ad7-0f48f654aaf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:29.811364 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3f335474-d648-4b23-9ad7-0f48f654aaf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:29.812165 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3f335474-d648-4b23-9ad7-0f48f654aaf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:29.812626 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3f335474-d648-4b23-9ad7-0f48f654aaf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:29.841520 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3f335474-d648-4b23-9ad7-0f48f654aaf5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042450 Mar 08 19:16:29.842503 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 211/423] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:16:29 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:30.188492 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7682c506-6cc1-4b9b-8c5e-31b6f4542fcb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:30.189204 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7682c506-6cc1-4b9b-8c5e-31b6f4542fcb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:30.195491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7682c506-6cc1-4b9b-8c5e-31b6f4542fcb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:30.196054 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7682c506-6cc1-4b9b-8c5e-31b6f4542fcb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:30.196820 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7682c506-6cc1-4b9b-8c5e-31b6f4542fcb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:30.197251 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7682c506-6cc1-4b9b-8c5e-31b6f4542fcb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:30.335602 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7682c506-6cc1-4b9b-8c5e-31b6f4542fcb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:30.343165 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7682c506-6cc1-4b9b-8c5e-31b6f4542fcb tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.159167 Mar 08 19:16:30.343715 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 213/424] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:30 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:30.853858 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3621ca6b-b25e-4b35-9d71-5621222b110c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:30.854765 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3621ca6b-b25e-4b35-9d71-5621222b110c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:30.860747 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3621ca6b-b25e-4b35-9d71-5621222b110c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:30.861202 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3621ca6b-b25e-4b35-9d71-5621222b110c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:30.861978 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3621ca6b-b25e-4b35-9d71-5621222b110c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:30.862414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3621ca6b-b25e-4b35-9d71-5621222b110c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:30.891206 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3621ca6b-b25e-4b35-9d71-5621222b110c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041289 Mar 08 19:16:30.891768 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 212/425] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:16:30 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:30.938765 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3858bca0-a830-4b33-b201-4f4139b3606c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:30.939264 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3858bca0-a830-4b33-b201-4f4139b3606c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:30.945163 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3858bca0-a830-4b33-b201-4f4139b3606c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:30.945611 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3858bca0-a830-4b33-b201-4f4139b3606c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:30.946372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3858bca0-a830-4b33-b201-4f4139b3606c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:30.946808 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3858bca0-a830-4b33-b201-4f4139b3606c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:30.970139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3858bca0-a830-4b33-b201-4f4139b3606c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/ips" status: 200 len: 146 microversion: 2.1 time: 0.036247 Mar 08 19:16:30.970703 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 214/426] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:16:30 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:31.360562 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-82c7af19-d167-4b54-acca-f956818b2541 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:31.361172 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-82c7af19-d167-4b54-acca-f956818b2541 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:31.367080 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-82c7af19-d167-4b54-acca-f956818b2541 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:31.367576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-82c7af19-d167-4b54-acca-f956818b2541 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:31.368376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-82c7af19-d167-4b54-acca-f956818b2541 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:31.368816 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-82c7af19-d167-4b54-acca-f956818b2541 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:31.502695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-82c7af19-d167-4b54-acca-f956818b2541 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:31.510113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-82c7af19-d167-4b54-acca-f956818b2541 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.154023 Mar 08 19:16:31.510728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 213/427] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:31 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:31.902749 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0974eb46-1c94-4028-870d-757404faab32 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:31.904435 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0974eb46-1c94-4028-870d-757404faab32 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:31.910734 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0974eb46-1c94-4028-870d-757404faab32 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:31.911190 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0974eb46-1c94-4028-870d-757404faab32 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:31.912006 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0974eb46-1c94-4028-870d-757404faab32 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:31.912452 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0974eb46-1c94-4028-870d-757404faab32 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:31.941154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0974eb46-1c94-4028-870d-757404faab32 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042367 Mar 08 19:16:31.941709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 215/428] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:16:31 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:16:32.526666 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b5cb7149-0e5f-422d-9a84-2d8b8bf6c477 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:32.527197 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b5cb7149-0e5f-422d-9a84-2d8b8bf6c477 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:32.533046 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b5cb7149-0e5f-422d-9a84-2d8b8bf6c477 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:32.533634 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b5cb7149-0e5f-422d-9a84-2d8b8bf6c477 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:32.534405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b5cb7149-0e5f-422d-9a84-2d8b8bf6c477 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:32.534838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b5cb7149-0e5f-422d-9a84-2d8b8bf6c477 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:32.670372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b5cb7149-0e5f-422d-9a84-2d8b8bf6c477 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:32.677819 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b5cb7149-0e5f-422d-9a84-2d8b8bf6c477 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.155036 Mar 08 19:16:32.678381 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 214/429] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:32 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:33.694978 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b4750c23-7f88-4fd6-8243-a95a3b6327e6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:33.695586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b4750c23-7f88-4fd6-8243-a95a3b6327e6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:33.702135 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b4750c23-7f88-4fd6-8243-a95a3b6327e6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:33.703247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b4750c23-7f88-4fd6-8243-a95a3b6327e6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:33.704201 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b4750c23-7f88-4fd6-8243-a95a3b6327e6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:33.704637 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b4750c23-7f88-4fd6-8243-a95a3b6327e6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:33.851387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b4750c23-7f88-4fd6-8243-a95a3b6327e6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:33.859581 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b4750c23-7f88-4fd6-8243-a95a3b6327e6 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.167890 Mar 08 19:16:33.860334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 216/430] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:33 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:34.881628 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-167fcf45-ac7c-40f9-a2c0-993a09a6100e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:34.882229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-167fcf45-ac7c-40f9-a2c0-993a09a6100e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:34.888427 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-167fcf45-ac7c-40f9-a2c0-993a09a6100e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:34.888878 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-167fcf45-ac7c-40f9-a2c0-993a09a6100e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:34.890172 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-167fcf45-ac7c-40f9-a2c0-993a09a6100e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:34.890612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-167fcf45-ac7c-40f9-a2c0-993a09a6100e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:35.025673 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-167fcf45-ac7c-40f9-a2c0-993a09a6100e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:35.033437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-167fcf45-ac7c-40f9-a2c0-993a09a6100e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.155670 Mar 08 19:16:35.033998 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 215/431] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:34 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:36.050259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0a9b1cbd-85af-4ad1-b8e6-a514fc2384dc tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:36.051029 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0a9b1cbd-85af-4ad1-b8e6-a514fc2384dc tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:36.057676 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0a9b1cbd-85af-4ad1-b8e6-a514fc2384dc tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:36.058156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0a9b1cbd-85af-4ad1-b8e6-a514fc2384dc tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:36.058982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0a9b1cbd-85af-4ad1-b8e6-a514fc2384dc tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:36.059477 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0a9b1cbd-85af-4ad1-b8e6-a514fc2384dc tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:36.214846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0a9b1cbd-85af-4ad1-b8e6-a514fc2384dc tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:36.222970 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0a9b1cbd-85af-4ad1-b8e6-a514fc2384dc tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1313 microversion: 2.1 time: 0.176641 Mar 08 19:16:36.223727 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 217/432] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:36 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:37.112064 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-144bc9d6-8e39-4579-86b6-afa6d2651fc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:37.112993 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-144bc9d6-8e39-4579-86b6-afa6d2651fc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:37.122539 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-144bc9d6-8e39-4579-86b6-afa6d2651fc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:37.123068 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-144bc9d6-8e39-4579-86b6-afa6d2651fc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:37.123867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-144bc9d6-8e39-4579-86b6-afa6d2651fc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:37.124340 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-144bc9d6-8e39-4579-86b6-afa6d2651fc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:37.151315 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-144bc9d6-8e39-4579-86b6-afa6d2651fc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/ips" status: 200 len: 152 microversion: 2.20 time: 0.043694 Mar 08 19:16:37.152136 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 216/433] 10.222.0.75 () {60 vars in 1288 bytes} [Tue Mar 8 19:16:37 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/ips => generated 152 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:16:37.244129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-644303b2-a6e5-4584-9205-e52115da03ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:37.244129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-644303b2-a6e5-4584-9205-e52115da03ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:37.251091 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-644303b2-a6e5-4584-9205-e52115da03ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:37.251675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-644303b2-a6e5-4584-9205-e52115da03ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:37.252680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-644303b2-a6e5-4584-9205-e52115da03ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:37.253220 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-644303b2-a6e5-4584-9205-e52115da03ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:37.389953 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-644303b2-a6e5-4584-9205-e52115da03ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:37.398775 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-644303b2-a6e5-4584-9205-e52115da03ab tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1496 microversion: 2.1 time: 0.160736 Mar 08 19:16:37.399354 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 218/434] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:37 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1496 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:39.617572 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7d53ab73-513c-4dbb-a028-6aef499f6055 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:39.618072 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7d53ab73-513c-4dbb-a028-6aef499f6055 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:39.625129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7d53ab73-513c-4dbb-a028-6aef499f6055 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:39.626938 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7d53ab73-513c-4dbb-a028-6aef499f6055 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:39.626938 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7d53ab73-513c-4dbb-a028-6aef499f6055 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:39.627213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7d53ab73-513c-4dbb-a028-6aef499f6055 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:39.652040 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7d53ab73-513c-4dbb-a028-6aef499f6055 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Going to try to terminate instance {{(pid=117390) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:16:40.038257 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7d53ab73-513c-4dbb-a028-6aef499f6055 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "DELETE /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 204 len: 0 microversion: 2.1 time: 0.424790 Mar 08 19:16:40.038844 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 217/435] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:16:39 2022] DELETE /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:16:40.048116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce899562-d80e-4b3a-8b54-d334ef905522 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:40.048743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ce899562-d80e-4b3a-8b54-d334ef905522 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:40.055118 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce899562-d80e-4b3a-8b54-d334ef905522 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:40.055558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce899562-d80e-4b3a-8b54-d334ef905522 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:40.056353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce899562-d80e-4b3a-8b54-d334ef905522 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:40.056781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce899562-d80e-4b3a-8b54-d334ef905522 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:40.195829 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ce899562-d80e-4b3a-8b54-d334ef905522 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:40.204812 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ce899562-d80e-4b3a-8b54-d334ef905522 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1502 microversion: 2.1 time: 0.161075 Mar 08 19:16:40.205373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 219/436] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:40 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1502 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:40.805858 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-05c63c06-71cb-4315-9a8b-aa65ca2461c0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:40.806602 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-05c63c06-71cb-4315-9a8b-aa65ca2461c0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:40.812472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-05c63c06-71cb-4315-9a8b-aa65ca2461c0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:40.813021 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-05c63c06-71cb-4315-9a8b-aa65ca2461c0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:40.813782 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-05c63c06-71cb-4315-9a8b-aa65ca2461c0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:40.814221 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-05c63c06-71cb-4315-9a8b-aa65ca2461c0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:40.836291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-05c63c06-71cb-4315-9a8b-aa65ca2461c0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lazy-loading 'flavor' on Instance uuid c1d4ea86-f489-4d6d-995e-1999c95b744d {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:16:41.222361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6cf13e0c-4020-4d9f-bedd-a7712e159b8f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:41.223085 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6cf13e0c-4020-4d9f-bedd-a7712e159b8f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:41.232254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6cf13e0c-4020-4d9f-bedd-a7712e159b8f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:41.232755 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6cf13e0c-4020-4d9f-bedd-a7712e159b8f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:41.233527 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6cf13e0c-4020-4d9f-bedd-a7712e159b8f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:41.233963 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6cf13e0c-4020-4d9f-bedd-a7712e159b8f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:41.374716 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6cf13e0c-4020-4d9f-bedd-a7712e159b8f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:41.383735 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6cf13e0c-4020-4d9f-bedd-a7712e159b8f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1502 microversion: 2.1 time: 0.165908 Mar 08 19:16:41.384443 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 220/437] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:41 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:41.443717 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-05c63c06-71cb-4315-9a8b-aa65ca2461c0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/action" status: 202 len: 0 microversion: 2.20 time: 0.641911 Mar 08 19:16:41.444453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 218/438] 10.222.0.75 () {62 vars in 1318 bytes} [Tue Mar 8 19:16:40 2022] POST /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:16:41.453009 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:41.453650 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:41.460072 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:41.460655 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:41.461420 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:41.461857 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:41.593088 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:41.600803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:41.602314 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:41.603451 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7cd07e2d-2cf6-4d4d-bf8c-f8092e9486d7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.154595 Mar 08 19:16:41.604013 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 221/439] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:41 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:42.402172 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-28990c5d-9b00-4df9-9802-9472e5167a20 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:42.403587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-28990c5d-9b00-4df9-9802-9472e5167a20 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:42.411212 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-28990c5d-9b00-4df9-9802-9472e5167a20 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:42.411792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-28990c5d-9b00-4df9-9802-9472e5167a20 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:42.412586 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-28990c5d-9b00-4df9-9802-9472e5167a20 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:42.412882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-28990c5d-9b00-4df9-9802-9472e5167a20 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:42.557590 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-28990c5d-9b00-4df9-9802-9472e5167a20 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:42.565602 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-28990c5d-9b00-4df9-9802-9472e5167a20 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1502 microversion: 2.1 time: 0.167641 Mar 08 19:16:42.566237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 219/440] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:42 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:42.622450 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:42.623054 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:42.629867 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:42.630405 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:42.631311 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:42.631797 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:42.801644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:42.809292 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:42.810835 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:42.811999 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c003796e-322c-4c5e-b25b-da58ce244017 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.193524 Mar 08 19:16:42.812544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 222/441] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:42 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:16:43.394163 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4ef7bfd6-0180-4dc3-9df3-4b1b29f96394 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:43.394674 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4ef7bfd6-0180-4dc3-9df3-4b1b29f96394 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:43.400869 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4ef7bfd6-0180-4dc3-9df3-4b1b29f96394 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:43.401308 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4ef7bfd6-0180-4dc3-9df3-4b1b29f96394 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:43.402068 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4ef7bfd6-0180-4dc3-9df3-4b1b29f96394 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:43.402495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4ef7bfd6-0180-4dc3-9df3-4b1b29f96394 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:43.426551 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4ef7bfd6-0180-4dc3-9df3-4b1b29f96394 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/ips" status: 200 len: 148 microversion: 2.1 time: 0.036163 Mar 08 19:16:43.427240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 220/442] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:16:43 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:43.583699 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4321e9c2-60f4-4245-b84e-dc001086ab75 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:43.584362 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4321e9c2-60f4-4245-b84e-dc001086ab75 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:43.590626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4321e9c2-60f4-4245-b84e-dc001086ab75 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:43.594562 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4321e9c2-60f4-4245-b84e-dc001086ab75 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:43.594562 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4321e9c2-60f4-4245-b84e-dc001086ab75 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:43.594562 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4321e9c2-60f4-4245-b84e-dc001086ab75 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:43.735249 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4321e9c2-60f4-4245-b84e-dc001086ab75 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:43.756811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4321e9c2-60f4-4245-b84e-dc001086ab75 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1502 microversion: 2.1 time: 0.177557 Mar 08 19:16:43.757376 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 223/443] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:43 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1502 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:43.831822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:43.832852 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:43.841054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:43.842944 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:43.842944 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:43.843339 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:43.997424 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:44.006173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:44.007719 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:44.008898 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e7ed889f-7341-44f1-ad03-4e769710999e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.181979 Mar 08 19:16:44.009455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 221/444] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:43 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:44.774314 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cd2acc1d-d4a5-4113-afdd-689035a715b5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:44.774927 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cd2acc1d-d4a5-4113-afdd-689035a715b5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:44.781360 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd2acc1d-d4a5-4113-afdd-689035a715b5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:44.781817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd2acc1d-d4a5-4113-afdd-689035a715b5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:44.783146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd2acc1d-d4a5-4113-afdd-689035a715b5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:44.783582 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cd2acc1d-d4a5-4113-afdd-689035a715b5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:44.927081 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cd2acc1d-d4a5-4113-afdd-689035a715b5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:44.934596 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cd2acc1d-d4a5-4113-afdd-689035a715b5 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1502 microversion: 2.1 time: 0.164116 Mar 08 19:16:44.935052 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 224/445] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:44 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:45.028233 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:45.028841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:45.035184 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:45.035642 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:45.036479 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:45.036905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:45.168663 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:45.179187 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:45.180740 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:45.182085 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b515156e-e204-4544-8b4b-5d9ac80fcdab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.157848 Mar 08 19:16:45.182626 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 222/446] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:45 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:45.953738 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9c806dd9-c304-4040-a487-28adf3f26b7e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:45.954796 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9c806dd9-c304-4040-a487-28adf3f26b7e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:45.962350 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9c806dd9-c304-4040-a487-28adf3f26b7e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:45.962912 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9c806dd9-c304-4040-a487-28adf3f26b7e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:45.963849 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9c806dd9-c304-4040-a487-28adf3f26b7e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:45.964359 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9c806dd9-c304-4040-a487-28adf3f26b7e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:46.096601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9c806dd9-c304-4040-a487-28adf3f26b7e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:46.104115 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9c806dd9-c304-4040-a487-28adf3f26b7e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1502 microversion: 2.1 time: 0.155492 Mar 08 19:16:46.104668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 225/447] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:45 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:46.200377 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:46.201101 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:46.207722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:46.208206 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:46.208978 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:46.209415 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:46.352638 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:46.361049 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:46.362575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:46.363723 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-41eb6ed5-479f-41d0-af00-d0ee6dc1152d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.167311 Mar 08 19:16:46.364313 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 223/448] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:46 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:16:47.121642 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-06ee5317-1d7a-4af8-a137-dad28ae1033f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:47.122256 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-06ee5317-1d7a-4af8-a137-dad28ae1033f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:47.129500 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-06ee5317-1d7a-4af8-a137-dad28ae1033f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:47.129960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-06ee5317-1d7a-4af8-a137-dad28ae1033f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:47.130737 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-06ee5317-1d7a-4af8-a137-dad28ae1033f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:47.131177 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-06ee5317-1d7a-4af8-a137-dad28ae1033f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:47.283241 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-06ee5317-1d7a-4af8-a137-dad28ae1033f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:47.291089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-06ee5317-1d7a-4af8-a137-dad28ae1033f tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1502 microversion: 2.1 time: 0.173196 Mar 08 19:16:47.298677 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 226/449] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:47 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:47.333042 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-cf5dc063-49d5-4016-9543-7d0874602744 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56225522-ec0b-4a7f-89c3-cfca9e6aed32"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:47.338838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-cf5dc063-49d5-4016-9543-7d0874602744 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:47.340430 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cf5dc063-49d5-4016-9543-7d0874602744 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:47.340881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cf5dc063-49d5-4016-9543-7d0874602744 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:47.341647 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cf5dc063-49d5-4016-9543-7d0874602744 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:47.342081 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cf5dc063-49d5-4016-9543-7d0874602744 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:47.385083 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:47.385083 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:47.391569 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:47.392371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:47.393159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:47.393598 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:47.544350 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:47.553069 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:47.554619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:47.555871 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b62699e8-9adf-4c98-b3a6-bfa0b8c30361 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.177452 Mar 08 19:16:47.556432 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 227/450] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:47 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:48.300983 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-cf5dc063-49d5-4016-9543-7d0874602744 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.972200 Mar 08 19:16:48.306617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 224/451] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:16:47 2022] POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/os-volume_attachments => generated 194 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:48.325837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2d290d37-5245-4cd5-82ef-f8b984c44dd0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:48.326501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2d290d37-5245-4cd5-82ef-f8b984c44dd0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:48.335602 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-c4643e24-16d5-4980-862b-6c02f51b5198 req-98e84a3b-6ef5-4525-a545-5a3bf11f69ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12866c93-9680-40b8-980d-3f3ab17a10ec", "name": "network-vif-deleted", "tag": "d9ffdfef-bbe5-4d98-a651-286c8a5f64da"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:48.343033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d290d37-5245-4cd5-82ef-f8b984c44dd0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.343484 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d290d37-5245-4cd5-82ef-f8b984c44dd0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.351264 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d290d37-5245-4cd5-82ef-f8b984c44dd0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.351264 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d290d37-5245-4cd5-82ef-f8b984c44dd0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.351445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-c4643e24-16d5-4980-862b-6c02f51b5198 req-98e84a3b-6ef5-4525-a545-5a3bf11f69ba service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.351445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-c4643e24-16d5-4980-862b-6c02f51b5198 req-98e84a3b-6ef5-4525-a545-5a3bf11f69ba service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.363132 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-c4643e24-16d5-4980-862b-6c02f51b5198 req-98e84a3b-6ef5-4525-a545-5a3bf11f69ba service nova] Creating event network-vif-deleted:d9ffdfef-bbe5-4d98-a651-286c8a5f64da for instance 12866c93-9680-40b8-980d-3f3ab17a10ec on hv-cinder-83009 Mar 08 19:16:48.373635 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-c4643e24-16d5-4980-862b-6c02f51b5198 req-98e84a3b-6ef5-4525-a545-5a3bf11f69ba service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045120 Mar 08 19:16:48.374204 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 225/452] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:48.379454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7a005973-1701-441e-82e6-b2c3350b5dc2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25b041f7-1519-4106-b55f-ac29e93a93ae"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:48.392466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7a005973-1701-441e-82e6-b2c3350b5dc2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:48.392466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7a005973-1701-441e-82e6-b2c3350b5dc2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.392466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7a005973-1701-441e-82e6-b2c3350b5dc2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.392466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7a005973-1701-441e-82e6-b2c3350b5dc2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.392785 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7a005973-1701-441e-82e6-b2c3350b5dc2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.441214 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2d290d37-5245-4cd5-82ef-f8b984c44dd0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:48.450225 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2d290d37-5245-4cd5-82ef-f8b984c44dd0 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1460 microversion: 2.1 time: 0.138479 Mar 08 19:16:48.467818 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 228/453] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:48 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1460 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:48.574692 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:48.575315 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:48.581415 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.581788 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.582541 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.582977 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.795051 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:48.806897 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:48.808842 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:48.810008 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-34af2594-45ce-4289-8ce2-191fc9b887ff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.239348 Mar 08 19:16:48.810743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 229/454] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:48 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:48.819453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cbf2c213-7167-4f86-b37e-209aaa27da4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:48.819453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cbf2c213-7167-4f86-b37e-209aaa27da4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:48.824464 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cbf2c213-7167-4f86-b37e-209aaa27da4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.824966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cbf2c213-7167-4f86-b37e-209aaa27da4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.825801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cbf2c213-7167-4f86-b37e-209aaa27da4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:48.826259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cbf2c213-7167-4f86-b37e-209aaa27da4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:48.850911 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cbf2c213-7167-4f86-b37e-209aaa27da4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:16:49.222773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cbf2c213-7167-4f86-b37e-209aaa27da4f tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "DELETE /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 204 len: 0 microversion: 2.1 time: 0.410501 Mar 08 19:16:49.227006 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 230/455] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:16:48 2022] DELETE /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:16:49.233559 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8497ab0d-5abd-44b5-8626-c4b6bee4b9c2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:49.234417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8497ab0d-5abd-44b5-8626-c4b6bee4b9c2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:49.240961 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8497ab0d-5abd-44b5-8626-c4b6bee4b9c2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:49.241415 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8497ab0d-5abd-44b5-8626-c4b6bee4b9c2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:49.242191 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8497ab0d-5abd-44b5-8626-c4b6bee4b9c2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:49.242642 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8497ab0d-5abd-44b5-8626-c4b6bee4b9c2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:49.327072 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7a005973-1701-441e-82e6-b2c3350b5dc2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.951015 Mar 08 19:16:49.331981 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 226/456] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:16:48 2022] POST /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:49.404587 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8497ab0d-5abd-44b5-8626-c4b6bee4b9c2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:49.416293 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8497ab0d-5abd-44b5-8626-c4b6bee4b9c2 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1507 microversion: 2.1 time: 0.187423 Mar 08 19:16:49.417159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 231/457] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:49 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1507 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:49.477261 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:49.478158 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:49.489568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:49.492832 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:49.493645 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:49.494120 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:49.539200 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:49.539658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:49.540153 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lazy-loading 'fault' on Instance uuid 12866c93-9680-40b8-980d-3f3ab17a10ec {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:16:49.591808 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98ec93c5dfaa4e6da92f6f86fce02e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdba71d13754424b826f9fb2b1ab5e6b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:49.598975 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a12ddf0c-76a5-4f0d-825d-12ff108bc57e tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 200 len: 1303 microversion: 2.1 time: 0.126219 Mar 08 19:16:49.599571 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 227/458] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:49 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 1303 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:49.832296 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:49.832905 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:49.839625 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:49.840169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:49.840985 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:49.841495 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:50.005676 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:50.013773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:50.015285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:50.016470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6242faa6-cab8-429f-93bf-6e1713d20c27 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.188966 Mar 08 19:16:50.017117 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 232/459] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:49 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:16:50.435044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5f4317f1-4349-4364-b1ca-28a638185747 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:50.435814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5f4317f1-4349-4364-b1ca-28a638185747 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:50.442793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5f4317f1-4349-4364-b1ca-28a638185747 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:50.443281 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5f4317f1-4349-4364-b1ca-28a638185747 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:50.444136 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5f4317f1-4349-4364-b1ca-28a638185747 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:50.444621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5f4317f1-4349-4364-b1ca-28a638185747 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:50.601627 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5f4317f1-4349-4364-b1ca-28a638185747 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:50.609567 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5f4317f1-4349-4364-b1ca-28a638185747 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1507 microversion: 2.1 time: 0.178678 Mar 08 19:16:50.610655 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 228/460] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:50 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1507 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:50.621125 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:50.621800 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] [instance: 12866c93-9680-40b8-980d-3f3ab17a10ec] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:50.629259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:50.629707 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:50.630517 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:50.632186 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:50.647094 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] HTTP exception thrown: Instance 12866c93-9680-40b8-980d-3f3ab17a10ec could not be found. Mar 08 19:16:50.647686 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] Returning 404 to user: Instance 12866c93-9680-40b8-980d-3f3ab17a10ec could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:16:50.648534 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-20cb055e-5872-4b56-8feb-8b242e25ba72 tempest-VolumesActionsTest-2006765495 tempest-VolumesActionsTest-2006765495-project] 10.222.0.75 "GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec" status: 404 len: 111 microversion: 2.1 time: 0.031724 Mar 08 19:16:50.649156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 233/461] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:50 2022] GET /compute/v2.1/servers/12866c93-9680-40b8-980d-3f3ab17a10ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:16:50.897577 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6bcb4864-6ba6-4b1b-abdb-8e4b9b4e6ec0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:50.898183 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6bcb4864-6ba6-4b1b-abdb-8e4b9b4e6ec0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:50.904528 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6bcb4864-6ba6-4b1b-abdb-8e4b9b4e6ec0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:50.904979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6bcb4864-6ba6-4b1b-abdb-8e4b9b4e6ec0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:50.912777 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6bcb4864-6ba6-4b1b-abdb-8e4b9b4e6ec0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:50.912777 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6bcb4864-6ba6-4b1b-abdb-8e4b9b4e6ec0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:51.005216 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-6bcb4864-6ba6-4b1b-abdb-8e4b9b4e6ec0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lazy-loading 'services' on Instance uuid 34bb0f82-aeaa-42b9-b40a-c5217b7a2115 {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:16:51.038679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:51.039311 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:51.045728 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:51.046177 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:51.046959 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:51.047420 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:51.198308 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:51.208604 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:51.210213 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:51.211444 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b247b8b4-739d-452d-ae91-6752f2d2fcb4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.180614 Mar 08 19:16:51.212426 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 234/462] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:51 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:51.243999 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6bcb4864-6ba6-4b1b-abdb-8e4b9b4e6ec0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "DELETE /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115/os-volume_attachments/5c2bdc0f-122d-46df-9005-4547431996c0" status: 202 len: 0 microversion: 2.1 time: 0.350132 Mar 08 19:16:51.244585 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 229/463] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:16:50 2022] DELETE /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115/os-volume_attachments/5c2bdc0f-122d-46df-9005-4547431996c0 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:16:51.627220 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-21482d46-4699-450a-9782-aa2941d365a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:51.628008 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-21482d46-4699-450a-9782-aa2941d365a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:51.638684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-21482d46-4699-450a-9782-aa2941d365a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:51.638684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-21482d46-4699-450a-9782-aa2941d365a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:51.638684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-21482d46-4699-450a-9782-aa2941d365a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:51.638684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-21482d46-4699-450a-9782-aa2941d365a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:51.783818 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-21482d46-4699-450a-9782-aa2941d365a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:51.791867 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-21482d46-4699-450a-9782-aa2941d365a5 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1507 microversion: 2.1 time: 0.169107 Mar 08 19:16:51.794218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 235/464] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:51 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:52.231363 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:52.231995 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:52.238712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:52.239187 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:52.239934 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:52.240389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:52.386055 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:52.395175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:52.396695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:52.397863 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-55a285bb-8825-45f0-881c-add6b01263e5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.171275 Mar 08 19:16:52.398416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 230/465] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:52 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:52.810987 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-dcc8b7d9-4e19-4670-b227-fa8e2fd5cb67 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:52.811714 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-dcc8b7d9-4e19-4670-b227-fa8e2fd5cb67 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:52.819161 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dcc8b7d9-4e19-4670-b227-fa8e2fd5cb67 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:52.819682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dcc8b7d9-4e19-4670-b227-fa8e2fd5cb67 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:52.820600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dcc8b7d9-4e19-4670-b227-fa8e2fd5cb67 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:52.821108 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dcc8b7d9-4e19-4670-b227-fa8e2fd5cb67 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:53.055763 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-dcc8b7d9-4e19-4670-b227-fa8e2fd5cb67 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:53.071010 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-dcc8b7d9-4e19-4670-b227-fa8e2fd5cb67 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1507 microversion: 2.1 time: 0.265208 Mar 08 19:16:53.071617 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 236/466] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:52 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:53.416632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:53.417463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:53.424581 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:53.425061 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:53.425832 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:53.426266 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:53.754588 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-23937d87-f85c-41d8-8cdc-c0f56b14b6c0 req-3851f0b5-c0d1-4d65-b742-d8bb4f0af63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abebaedb-474b-4500-9076-7c3f12d33513", "name": "network-vif-deleted", "tag": "f5b10e88-0abd-4904-ac5c-9598e04d2762"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:16:53.764522 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-23937d87-f85c-41d8-8cdc-c0f56b14b6c0 req-3851f0b5-c0d1-4d65-b742-d8bb4f0af63b service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:53.765096 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-23937d87-f85c-41d8-8cdc-c0f56b14b6c0 req-3851f0b5-c0d1-4d65-b742-d8bb4f0af63b service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:53.776795 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-23937d87-f85c-41d8-8cdc-c0f56b14b6c0 req-3851f0b5-c0d1-4d65-b742-d8bb4f0af63b service nova] Creating event network-vif-deleted:f5b10e88-0abd-4904-ac5c-9598e04d2762 for instance abebaedb-474b-4500-9076-7c3f12d33513 on hv-cinder-83009 Mar 08 19:16:53.781966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-23937d87-f85c-41d8-8cdc-c0f56b14b6c0 req-3851f0b5-c0d1-4d65-b742-d8bb4f0af63b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Mar 08 19:16:53.783115 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 237/467] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:16:53.834309 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:53.842047 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:53.843625 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:53.844726 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e0ee99f4-f343-41ee-825a-75310754a940 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.432211 Mar 08 19:16:53.845282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 231/468] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:53 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:54.091347 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-237c5e97-b31d-4f58-bac6-f715367b9461 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:54.092079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-237c5e97-b31d-4f58-bac6-f715367b9461 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:54.098719 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-237c5e97-b31d-4f58-bac6-f715367b9461 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:54.099166 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-237c5e97-b31d-4f58-bac6-f715367b9461 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:54.099977 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-237c5e97-b31d-4f58-bac6-f715367b9461 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:54.100417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-237c5e97-b31d-4f58-bac6-f715367b9461 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:54.176926 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-237c5e97-b31d-4f58-bac6-f715367b9461 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:54.184543 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-237c5e97-b31d-4f58-bac6-f715367b9461 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1465 microversion: 2.1 time: 0.097634 Mar 08 19:16:54.185104 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 238/469] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:54 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1465 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:54.863774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:54.864405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:54.870746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:54.871193 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:54.871979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:54.872419 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:55.016797 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:55.025762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:55.027282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:55.028478 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2c13cd43-a7bf-45ec-bc4f-6d0ba78705fa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.169256 Mar 08 19:16:55.029040 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 232/470] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:54 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:55.201578 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7e3006b2-526d-4662-a37d-8929dde00696 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:55.202175 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7e3006b2-526d-4662-a37d-8929dde00696 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:55.208254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7e3006b2-526d-4662-a37d-8929dde00696 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:55.208796 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7e3006b2-526d-4662-a37d-8929dde00696 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:55.209600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7e3006b2-526d-4662-a37d-8929dde00696 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:55.209986 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7e3006b2-526d-4662-a37d-8929dde00696 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:55.275718 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7e3006b2-526d-4662-a37d-8929dde00696 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:55.282948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7e3006b2-526d-4662-a37d-8929dde00696 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1293 microversion: 2.1 time: 0.085253 Mar 08 19:16:55.283500 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 239/471] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:55 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:56.046398 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:56.047007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:56.053412 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:56.053907 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:56.054630 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:56.055072 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:56.196230 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:56.203940 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:56.205529 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:56.207346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-481ccc9f-2940-4cde-ae31-9087e2f4c34f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.164758 Mar 08 19:16:56.207894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 233/472] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:56 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:16:56.301236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8f138484-d466-4722-933d-cfc3d0e3759a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:56.301863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8f138484-d466-4722-933d-cfc3d0e3759a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:56.308177 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f138484-d466-4722-933d-cfc3d0e3759a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:56.308632 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f138484-d466-4722-933d-cfc3d0e3759a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:56.309400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f138484-d466-4722-933d-cfc3d0e3759a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:56.309837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f138484-d466-4722-933d-cfc3d0e3759a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:56.372531 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8f138484-d466-4722-933d-cfc3d0e3759a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:56.380534 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8f138484-d466-4722-933d-cfc3d0e3759a tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1293 microversion: 2.1 time: 0.084005 Mar 08 19:16:56.381102 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 240/473] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:56 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1293 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:56.583720 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:16:56.583937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:16:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:16:57.225643 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:57.226253 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:57.232521 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:57.232970 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:57.233756 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:57.234191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:57.368114 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:57.375844 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:57.378010 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:57.379163 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-eaf26434-29ba-4bba-b414-3f7f9ec2deaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.157795 Mar 08 19:16:57.379709 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 234/474] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:57 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:16:57.398497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c01b2e42-1501-437a-87f0-7ff3e6187522 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:57.399750 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c01b2e42-1501-437a-87f0-7ff3e6187522 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:57.405771 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c01b2e42-1501-437a-87f0-7ff3e6187522 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:57.406251 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c01b2e42-1501-437a-87f0-7ff3e6187522 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:57.407025 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c01b2e42-1501-437a-87f0-7ff3e6187522 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:57.407460 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c01b2e42-1501-437a-87f0-7ff3e6187522 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:57.471894 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c01b2e42-1501-437a-87f0-7ff3e6187522 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:57.480436 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c01b2e42-1501-437a-87f0-7ff3e6187522 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1293 microversion: 2.1 time: 0.086839 Mar 08 19:16:57.481466 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 241/475] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:57 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:16:58.401866 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:58.402504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:58.409651 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:58.410964 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:58.410964 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:58.411334 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:58.498936 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:58.499590 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:58.506689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:58.507250 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:58.508553 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:58.509344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:58.544133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:58.544694 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:58.545137 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lazy-loading 'fault' on Instance uuid abebaedb-474b-4500-9076-7c3f12d33513 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:16:58.559387 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:58.567971 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:58.569662 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:58.570835 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b981c0b1-32b7-4074-89e6-c4b1ce38a740 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.172960 Mar 08 19:16:58.571386 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 235/476] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:58 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:16:58.586174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:58.593404 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-79470046-2345-4b04-bbae-c158e4aa1039 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 200 len: 1312 microversion: 2.1 time: 0.099457 Mar 08 19:16:58.593961 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 242/477] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:58 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:16:59.589895 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:59.590755 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:59.597481 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:59.598148 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:59.598926 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:59.599366 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:59.610470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:59.611478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: abebaedb-474b-4500-9076-7c3f12d33513] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:59.619398 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:59.620198 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:59.621391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:59.622139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:59.675487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] HTTP exception thrown: Instance abebaedb-474b-4500-9076-7c3f12d33513 could not be found. Mar 08 19:16:59.676129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Returning 404 to user: Instance abebaedb-474b-4500-9076-7c3f12d33513 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:16:59.677208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-30fe6e1c-0580-48d2-9c72-d59e2a916d28 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513" status: 404 len: 111 microversion: 2.1 time: 0.070611 Mar 08 19:16:59.677768 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 243/478] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:16:59 2022] GET /compute/v2.1/servers/abebaedb-474b-4500-9076-7c3f12d33513 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:16:59.686691 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-06b269dd-7525-457a-85d2-f9a94003a45c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:16:59.687485 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-06b269dd-7525-457a-85d2-f9a94003a45c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:16:59.696503 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-06b269dd-7525-457a-85d2-f9a94003a45c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:59.702075 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-06b269dd-7525-457a-85d2-f9a94003a45c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:59.703144 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-06b269dd-7525-457a-85d2-f9a94003a45c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:16:59.715473 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-06b269dd-7525-457a-85d2-f9a94003a45c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:16:59.756883 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-06b269dd-7525-457a-85d2-f9a94003a45c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:16:59.851236 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:59.861858 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:59.863628 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:16:59.865037 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b8b0fff3-b137-4b3e-86b3-30ca74189aff tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.279023 Mar 08 19:16:59.865780 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 236/479] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:16:59 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:00.152348 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-06b269dd-7525-457a-85d2-f9a94003a45c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 204 len: 0 microversion: 2.1 time: 0.469193 Mar 08 19:17:00.152949 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 244/480] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:16:59 2022] DELETE /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:17:00.163341 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0dfca3ca-5bc6-4a3e-8620-ccf0a028e9e9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:00.167222 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0dfca3ca-5bc6-4a3e-8620-ccf0a028e9e9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:00.171331 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0dfca3ca-5bc6-4a3e-8620-ccf0a028e9e9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:00.172366 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0dfca3ca-5bc6-4a3e-8620-ccf0a028e9e9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:00.173833 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0dfca3ca-5bc6-4a3e-8620-ccf0a028e9e9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:00.174432 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0dfca3ca-5bc6-4a3e-8620-ccf0a028e9e9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:00.343344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d3c1a451-7dc1-46ce-b196-8f36f1dbd99c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:00.350952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d3c1a451-7dc1-46ce-b196-8f36f1dbd99c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:00.350952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d3c1a451-7dc1-46ce-b196-8f36f1dbd99c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:00.426619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d3c1a451-7dc1-46ce-b196-8f36f1dbd99c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Going to try to stop instance {{(pid=117391) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 19:17:00.470492 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0dfca3ca-5bc6-4a3e-8620-ccf0a028e9e9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:00.490424 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0dfca3ca-5bc6-4a3e-8620-ccf0a028e9e9 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.332585 Mar 08 19:17:00.501573 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 237/481] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:00 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:00.693002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d3c1a451-7dc1-46ce-b196-8f36f1dbd99c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/action" status: 202 len: 0 microversion: 2.1 time: 0.353310 Mar 08 19:17:00.696316 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 245/482] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:17:00 2022] POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:17:00.716904 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ffc11371-eed0-4df8-ab20-f67a8b5a4d8f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:00.719491 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ffc11371-eed0-4df8-ab20-f67a8b5a4d8f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:00.734526 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ffc11371-eed0-4df8-ab20-f67a8b5a4d8f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:00.736437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ffc11371-eed0-4df8-ab20-f67a8b5a4d8f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:00.738382 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ffc11371-eed0-4df8-ab20-f67a8b5a4d8f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:00.739030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ffc11371-eed0-4df8-ab20-f67a8b5a4d8f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:00.892920 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:00.897754 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:00.913852 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:00.916742 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:00.924477 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:00.929553 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:01.094215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ffc11371-eed0-4df8-ab20-f67a8b5a4d8f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:01.103860 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ffc11371-eed0-4df8-ab20-f67a8b5a4d8f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.401911 Mar 08 19:17:01.105111 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 238/483] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:00 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:01.225198 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:01.249380 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:01.255723 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:01.257490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9ea73e13-5b8b-43b1-bb09-bee1dd5ffc19 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.371121 Mar 08 19:17:01.258051 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 246/484] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:00 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:01.518351 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-47da2702-8b6b-4f54-a5cf-bf06a53cb362 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:01.519462 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-47da2702-8b6b-4f54-a5cf-bf06a53cb362 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:01.533656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47da2702-8b6b-4f54-a5cf-bf06a53cb362 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:01.535197 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47da2702-8b6b-4f54-a5cf-bf06a53cb362 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:01.538587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47da2702-8b6b-4f54-a5cf-bf06a53cb362 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:01.540248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47da2702-8b6b-4f54-a5cf-bf06a53cb362 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:01.712769 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-47da2702-8b6b-4f54-a5cf-bf06a53cb362 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:01.721392 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-47da2702-8b6b-4f54-a5cf-bf06a53cb362 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.216048 Mar 08 19:17:01.723372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 239/485] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:01 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:02.125003 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e4b6166d-ccd1-4871-abc4-0d8fee335e8a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:02.126334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e4b6166d-ccd1-4871-abc4-0d8fee335e8a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:02.146538 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4b6166d-ccd1-4871-abc4-0d8fee335e8a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:02.147201 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4b6166d-ccd1-4871-abc4-0d8fee335e8a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:02.148299 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4b6166d-ccd1-4871-abc4-0d8fee335e8a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:02.148834 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4b6166d-ccd1-4871-abc4-0d8fee335e8a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:02.290477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:02.293404 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:02.318043 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:02.318609 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:02.320015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:02.320751 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:02.369843 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e4b6166d-ccd1-4871-abc4-0d8fee335e8a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:02.383452 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e4b6166d-ccd1-4871-abc4-0d8fee335e8a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.263237 Mar 08 19:17:02.384089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 247/486] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:02 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:02.518444 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:02.529459 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:02.531286 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:02.532497 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-585122d5-274a-47bb-ae82-164d2e0f0c2c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.250718 Mar 08 19:17:02.548113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 240/487] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:02 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:02.740565 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3d8c9e1c-38a9-4676-ba9a-2d56be071e21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:02.741362 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3d8c9e1c-38a9-4676-ba9a-2d56be071e21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:02.748237 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e1c-38a9-4676-ba9a-2d56be071e21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:02.748848 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e1c-38a9-4676-ba9a-2d56be071e21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:02.749947 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e1c-38a9-4676-ba9a-2d56be071e21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:02.750551 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e1c-38a9-4676-ba9a-2d56be071e21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:02.909481 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3d8c9e1c-38a9-4676-ba9a-2d56be071e21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:02.919111 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3d8c9e1c-38a9-4676-ba9a-2d56be071e21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.183734 Mar 08 19:17:02.932101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 248/488] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:02 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:03.180941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:17:03.181800 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:17:03.402719 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9823293d-51b3-4d77-b936-bd96d59412f6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:03.403483 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9823293d-51b3-4d77-b936-bd96d59412f6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:03.411082 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9823293d-51b3-4d77-b936-bd96d59412f6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:03.411553 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9823293d-51b3-4d77-b936-bd96d59412f6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:03.412387 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9823293d-51b3-4d77-b936-bd96d59412f6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:03.413010 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9823293d-51b3-4d77-b936-bd96d59412f6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:03.557764 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:03.559082 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:03.567737 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:03.570224 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:03.573373 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9823293d-51b3-4d77-b936-bd96d59412f6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:03.577024 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:03.577952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:03.583362 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9823293d-51b3-4d77-b936-bd96d59412f6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.184422 Mar 08 19:17:03.584114 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 241/489] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:03 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:03.721353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:03.731090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:03.732862 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:03.734181 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7f0fb4d6-47db-44b6-b923-a6dde6849aea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.181216 Mar 08 19:17:03.735017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 249/490] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:03 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:03.936296 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9efc0f78-3ae8-406a-b89b-72aa28d6801d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:03.937291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9efc0f78-3ae8-406a-b89b-72aa28d6801d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:03.946726 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9efc0f78-3ae8-406a-b89b-72aa28d6801d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:03.947267 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9efc0f78-3ae8-406a-b89b-72aa28d6801d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:03.948156 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9efc0f78-3ae8-406a-b89b-72aa28d6801d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:03.948839 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9efc0f78-3ae8-406a-b89b-72aa28d6801d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:04.124516 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9efc0f78-3ae8-406a-b89b-72aa28d6801d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:04.134617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9efc0f78-3ae8-406a-b89b-72aa28d6801d tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.201867 Mar 08 19:17:04.135183 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 242/491] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:03 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:04.602481 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8aafc224-da70-48d6-a3ea-25d7db0fb16e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:04.603124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8aafc224-da70-48d6-a3ea-25d7db0fb16e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:04.609335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8aafc224-da70-48d6-a3ea-25d7db0fb16e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:04.609791 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8aafc224-da70-48d6-a3ea-25d7db0fb16e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:04.610575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8aafc224-da70-48d6-a3ea-25d7db0fb16e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:04.611196 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8aafc224-da70-48d6-a3ea-25d7db0fb16e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:04.753034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:04.753643 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:04.760187 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:04.760722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:04.761793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:04.762234 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:04.772695 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8aafc224-da70-48d6-a3ea-25d7db0fb16e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:04.788964 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8aafc224-da70-48d6-a3ea-25d7db0fb16e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.191095 Mar 08 19:17:04.789756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 250/492] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:04 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:04.911112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:04.919152 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:04.925466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:04.925466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7264ffe2-953f-4c1d-bfd0-e4362f276c04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.172910 Mar 08 19:17:04.925466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 243/493] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:04 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:05.154680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-526639c5-1120-49fa-bc87-a1715f9f989c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:05.156289 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-526639c5-1120-49fa-bc87-a1715f9f989c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:05.169037 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-526639c5-1120-49fa-bc87-a1715f9f989c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:05.175361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-526639c5-1120-49fa-bc87-a1715f9f989c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:05.175361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-526639c5-1120-49fa-bc87-a1715f9f989c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:05.175361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-526639c5-1120-49fa-bc87-a1715f9f989c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:05.375942 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-526639c5-1120-49fa-bc87-a1715f9f989c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:05.385337 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-526639c5-1120-49fa-bc87-a1715f9f989c tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.236458 Mar 08 19:17:05.395424 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 251/494] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:05 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:05.806907 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c8867f00-beb1-4efa-9595-d3a6c176a117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:05.807610 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c8867f00-beb1-4efa-9595-d3a6c176a117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:05.813736 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c8867f00-beb1-4efa-9595-d3a6c176a117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:05.814463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c8867f00-beb1-4efa-9595-d3a6c176a117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:05.816282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c8867f00-beb1-4efa-9595-d3a6c176a117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:05.816733 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c8867f00-beb1-4efa-9595-d3a6c176a117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:05.948143 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:05.949413 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:05.959003 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:05.959798 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:05.961079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:05.961856 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:06.022826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c8867f00-beb1-4efa-9595-d3a6c176a117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:06.035970 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c8867f00-beb1-4efa-9595-d3a6c176a117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.228842 Mar 08 19:17:06.046509 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 244/495] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:05 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:06.144706 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:06.158073 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:06.160518 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:06.162214 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c8573f8b-1d2f-4235-9c75-e7eeab789188 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.225762 Mar 08 19:17:06.163359 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 252/496] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:05 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:06.415002 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-91b39942-a8fc-4a32-ae8b-abec1dd21131 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:06.415948 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-91b39942-a8fc-4a32-ae8b-abec1dd21131 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:06.422729 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-91b39942-a8fc-4a32-ae8b-abec1dd21131 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:06.423516 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-91b39942-a8fc-4a32-ae8b-abec1dd21131 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:06.424608 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-91b39942-a8fc-4a32-ae8b-abec1dd21131 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:06.427836 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-91b39942-a8fc-4a32-ae8b-abec1dd21131 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:06.652157 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-91b39942-a8fc-4a32-ae8b-abec1dd21131 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:06.661882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-91b39942-a8fc-4a32-ae8b-abec1dd21131 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.261573 Mar 08 19:17:06.662583 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 245/497] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:06 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:07.060913 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a4333145-6edb-4e11-9ad1-27ef6a0829d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:07.062934 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a4333145-6edb-4e11-9ad1-27ef6a0829d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:07.087971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a4333145-6edb-4e11-9ad1-27ef6a0829d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:07.089656 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a4333145-6edb-4e11-9ad1-27ef6a0829d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:07.094493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a4333145-6edb-4e11-9ad1-27ef6a0829d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:07.098824 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a4333145-6edb-4e11-9ad1-27ef6a0829d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:07.186182 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:07.189596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:07.205147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:07.208150 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:07.210018 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:07.210954 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:07.579585 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:07.589169 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:07.590713 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:07.591939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b83f4e73-9347-4596-b68a-528ab250bc03 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.413723 Mar 08 19:17:07.592479 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a4333145-6edb-4e11-9ad1-27ef6a0829d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:07.592629 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 246/498] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:07 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:07.610322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a4333145-6edb-4e11-9ad1-27ef6a0829d2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.560403 Mar 08 19:17:07.624048 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 253/499] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:07 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:07.680953 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-da62ca97-af64-4e51-9cc1-c9291fcddc34 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:07.681561 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-da62ca97-af64-4e51-9cc1-c9291fcddc34 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:07.687640 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da62ca97-af64-4e51-9cc1-c9291fcddc34 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:07.688121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da62ca97-af64-4e51-9cc1-c9291fcddc34 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:07.688966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da62ca97-af64-4e51-9cc1-c9291fcddc34 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:07.689353 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da62ca97-af64-4e51-9cc1-c9291fcddc34 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:07.915021 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-da62ca97-af64-4e51-9cc1-c9291fcddc34 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:07.923794 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-da62ca97-af64-4e51-9cc1-c9291fcddc34 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1521 microversion: 2.1 time: 0.246685 Mar 08 19:17:07.926046 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 247/500] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:07 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:08.533783 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-34813347-f0ba-488d-81f1-231a96689696 req-996c4bd8-8dfe-4b83-be83-857ebc861e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0189cf74-75db-4a6a-ae65-de5aec2f2ae2", "name": "network-vif-deleted", "tag": "44706abe-99b3-4515-9c94-ae08c20efdd8"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:08.546567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-34813347-f0ba-488d-81f1-231a96689696 req-996c4bd8-8dfe-4b83-be83-857ebc861e31 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:08.547472 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-34813347-f0ba-488d-81f1-231a96689696 req-996c4bd8-8dfe-4b83-be83-857ebc861e31 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:08.561591 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-34813347-f0ba-488d-81f1-231a96689696 req-996c4bd8-8dfe-4b83-be83-857ebc861e31 service nova] Creating event network-vif-deleted:44706abe-99b3-4515-9c94-ae08c20efdd8 for instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 on hv-cinder-83009 Mar 08 19:17:08.568191 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-34813347-f0ba-488d-81f1-231a96689696 req-996c4bd8-8dfe-4b83-be83-857ebc861e31 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039052 Mar 08 19:17:08.568789 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 254/501] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:17:08.611281 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:08.611766 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:08.622129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:08.622746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:08.623690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:08.624312 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:08.641092 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b17c335b-1c9a-4eca-ab2a-626162e6e31e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:08.641092 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b17c335b-1c9a-4eca-ab2a-626162e6e31e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:08.660919 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b17c335b-1c9a-4eca-ab2a-626162e6e31e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:08.663163 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b17c335b-1c9a-4eca-ab2a-626162e6e31e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:08.665811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b17c335b-1c9a-4eca-ab2a-626162e6e31e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:08.672850 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b17c335b-1c9a-4eca-ab2a-626162e6e31e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:08.950978 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:08.959831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:08.961347 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:08.962502 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-84803d71-dac0-453c-b64f-e00b14884260 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.355612 Mar 08 19:17:08.963293 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 248/502] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:08 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:08.972448 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-139d5ce4-6f33-4cad-8fc9-ac55829f1854 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: .version_select at 0x7f4390086ee0>, body: {"keypair": {"name": "tempest-keypair-128913314"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:08.985623 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b17c335b-1c9a-4eca-ab2a-626162e6e31e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:08.997632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-139d5ce4-6f33-4cad-8fc9-ac55829f1854 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:17:09.002607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-139d5ce4-6f33-4cad-8fc9-ac55829f1854 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:17:09.022431 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b17c335b-1c9a-4eca-ab2a-626162e6e31e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.389077 Mar 08 19:17:09.038807 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 255/503] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:08 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:09.044996 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:09.045938 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:09.053858 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:09.054625 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:09.056177 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:09.056786 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:09.094236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:09.094999 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:09.095705 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lazy-loading 'fault' on Instance uuid 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:17:09.138921 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fa9bfb4bd114dae8babde95970d36a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac3e528a3aa34615a7a87b17e74c1f34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:09.147966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c827b95f-84c2-4b43-8ff2-02de1cf3dc90 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 200 len: 1312 microversion: 2.1 time: 0.107592 Mar 08 19:17:09.148954 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 256/504] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:09 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:09.319787 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-139d5ce4-6f33-4cad-8fc9-ac55829f1854 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:17:09.323868 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-139d5ce4-6f33-4cad-8fc9-ac55829f1854 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:17:09.342171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-139d5ce4-6f33-4cad-8fc9-ac55829f1854 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.373939 Mar 08 19:17:09.348068 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 249/505] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:17:08 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:09.569140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-512d6f14-328a-45e2-94db-5e6bbe10c808 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:09.569844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-512d6f14-328a-45e2-94db-5e6bbe10c808 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:09.591655 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-512d6f14-328a-45e2-94db-5e6bbe10c808 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:09.592382 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-512d6f14-328a-45e2-94db-5e6bbe10c808 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:09.593973 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-512d6f14-328a-45e2-94db-5e6bbe10c808 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:09.594581 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-512d6f14-328a-45e2-94db-5e6bbe10c808 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:09.644468 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-512d6f14-328a-45e2-94db-5e6bbe10c808 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:17:09.984349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:09.985077 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:09.992010 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:09.992469 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:09.993250 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:09.993690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:10.055403 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-512d6f14-328a-45e2-94db-5e6bbe10c808 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "DELETE /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 204 len: 0 microversion: 2.1 time: 0.490575 Mar 08 19:17:10.056465 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 257/506] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:17:09 2022] DELETE /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:17:10.067685 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-54776fdb-dcb8-47d2-85ba-2ea759a5221d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:10.070772 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-54776fdb-dcb8-47d2-85ba-2ea759a5221d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:10.075414 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-54776fdb-dcb8-47d2-85ba-2ea759a5221d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:10.076175 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-54776fdb-dcb8-47d2-85ba-2ea759a5221d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:10.077522 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-54776fdb-dcb8-47d2-85ba-2ea759a5221d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:10.078130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-54776fdb-dcb8-47d2-85ba-2ea759a5221d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:10.259112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:10.272568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:10.275838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:10.278067 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4dc7b715-c388-4d40-84cf-ab65c2601d4f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1745 microversion: 2.20 time: 0.297660 Mar 08 19:17:10.290413 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 250/507] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:09 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1745 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:10.296517 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c11be5c8-01f0-4aa2-b2ac-0c195b2683ca tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:10.297454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c11be5c8-01f0-4aa2-b2ac-0c195b2683ca tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:10.306525 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c11be5c8-01f0-4aa2-b2ac-0c195b2683ca tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:10.307264 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c11be5c8-01f0-4aa2-b2ac-0c195b2683ca tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:10.308314 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c11be5c8-01f0-4aa2-b2ac-0c195b2683ca tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:10.308903 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c11be5c8-01f0-4aa2-b2ac-0c195b2683ca tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:10.461854 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-54776fdb-dcb8-47d2-85ba-2ea759a5221d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:10.473346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-54776fdb-dcb8-47d2-85ba-2ea759a5221d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.410323 Mar 08 19:17:10.474621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 258/508] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:10 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:10.479594 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:10.484471 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] [instance: 0189cf74-75db-4a6a-ae65-de5aec2f2ae2] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:10.487122 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:10.488559 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:10.489695 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:10.490366 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:10.510712 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] HTTP exception thrown: Instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 could not be found. Mar 08 19:17:10.512014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] Returning 404 to user: Instance 0189cf74-75db-4a6a-ae65-de5aec2f2ae2 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:17:10.519066 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d89fe092-7576-4b4d-a0ba-9a526a9fbd21 tempest-ServerRescueNegativeTestJSON-1235630258 tempest-ServerRescueNegativeTestJSON-1235630258-project] 10.222.0.75 "GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2" status: 404 len: 111 microversion: 2.1 time: 0.037253 Mar 08 19:17:10.519066 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 259/509] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:10 2022] GET /compute/v2.1/servers/0189cf74-75db-4a6a-ae65-de5aec2f2ae2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:17:10.572296 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c11be5c8-01f0-4aa2-b2ac-0c195b2683ca tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:10.581397 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c11be5c8-01f0-4aa2-b2ac-0c195b2683ca tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1513 microversion: 2.1 time: 0.288650 Mar 08 19:17:10.604431 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 251/510] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:10 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1513 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:11.299190 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:11.314152 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:11.322184 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:11.322735 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:11.323606 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:11.324142 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:11.496352 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-226831e5-0970-4c3a-928a-c0dd0d8fcaca tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:11.497126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-226831e5-0970-4c3a-928a-c0dd0d8fcaca tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:11.500418 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:11.504000 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-226831e5-0970-4c3a-928a-c0dd0d8fcaca tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:11.510248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-226831e5-0970-4c3a-928a-c0dd0d8fcaca tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:11.510248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-226831e5-0970-4c3a-928a-c0dd0d8fcaca tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:11.510248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-226831e5-0970-4c3a-928a-c0dd0d8fcaca tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:11.512033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:11.515325 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:11.516849 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b469340c-898f-4f18-94f5-9eec7ace9ac4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1745 microversion: 2.20 time: 0.222197 Mar 08 19:17:11.517373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 260/511] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:11 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:11.608551 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-706529ed-8b5d-4838-b5ad-c0656f818f8a tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:11.610344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-706529ed-8b5d-4838-b5ad-c0656f818f8a tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:11.619785 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-706529ed-8b5d-4838-b5ad-c0656f818f8a tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:11.620981 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-706529ed-8b5d-4838-b5ad-c0656f818f8a tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:11.622089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-706529ed-8b5d-4838-b5ad-c0656f818f8a tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:11.622089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-706529ed-8b5d-4838-b5ad-c0656f818f8a tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:11.802546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-226831e5-0970-4c3a-928a-c0dd0d8fcaca tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:11.823557 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-226831e5-0970-4c3a-928a-c0dd0d8fcaca tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.329778 Mar 08 19:17:11.835722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 252/512] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:11 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:11.858664 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-706529ed-8b5d-4838-b5ad-c0656f818f8a tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:11.866847 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-706529ed-8b5d-4838-b5ad-c0656f818f8a tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1513 microversion: 2.1 time: 0.270845 Mar 08 19:17:11.876914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 261/513] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:11 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1513 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:12.539332 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:12.548158 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:12.552413 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:12.553101 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:12.554066 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:12.554662 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:12.843201 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-adb5270e-69f6-4786-9792-247251f32fd7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:12.844821 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-adb5270e-69f6-4786-9792-247251f32fd7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:12.847354 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:12.860200 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-adb5270e-69f6-4786-9792-247251f32fd7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:12.861085 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:12.862130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-adb5270e-69f6-4786-9792-247251f32fd7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:12.862750 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:12.863856 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-adb5270e-69f6-4786-9792-247251f32fd7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:12.864586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-adb5270e-69f6-4786-9792-247251f32fd7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:12.873436 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-09683c66-6bfb-4e43-a348-3e08b0353ddb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1745 microversion: 2.20 time: 0.339054 Mar 08 19:17:12.874295 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 253/514] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:12 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1745 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:12.883710 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-860aa9a6-2b4f-4587-9e1c-268e4f75e3b4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:12.884408 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-860aa9a6-2b4f-4587-9e1c-268e4f75e3b4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:12.903604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-860aa9a6-2b4f-4587-9e1c-268e4f75e3b4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:12.904116 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-860aa9a6-2b4f-4587-9e1c-268e4f75e3b4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:12.904900 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-860aa9a6-2b4f-4587-9e1c-268e4f75e3b4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:12.905359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-860aa9a6-2b4f-4587-9e1c-268e4f75e3b4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:13.306589 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-adb5270e-69f6-4786-9792-247251f32fd7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:13.310407 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-860aa9a6-2b4f-4587-9e1c-268e4f75e3b4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:13.319092 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-860aa9a6-2b4f-4587-9e1c-268e4f75e3b4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1513 microversion: 2.1 time: 0.439357 Mar 08 19:17:13.321644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-adb5270e-69f6-4786-9792-247251f32fd7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.479660 Mar 08 19:17:13.323730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 254/515] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:12 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1513 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:13.328374 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 262/516] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:12 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:13.818912 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-7022b926-58a6-471f-a57a-f24fa6628f99 req-a0ac2b01-10db-49e1-88d1-751c518538be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34bb0f82-aeaa-42b9-b40a-c5217b7a2115", "name": "network-vif-deleted", "tag": "72fb0b49-ef73-4842-996c-d54211ee6abb"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:13.834818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-7022b926-58a6-471f-a57a-f24fa6628f99 req-a0ac2b01-10db-49e1-88d1-751c518538be service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:13.837141 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-7022b926-58a6-471f-a57a-f24fa6628f99 req-a0ac2b01-10db-49e1-88d1-751c518538be service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:13.853823 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-7022b926-58a6-471f-a57a-f24fa6628f99 req-a0ac2b01-10db-49e1-88d1-751c518538be service nova] Creating event network-vif-deleted:72fb0b49-ef73-4842-996c-d54211ee6abb for instance 34bb0f82-aeaa-42b9-b40a-c5217b7a2115 on hv-cinder-83009 Mar 08 19:17:13.860695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-7022b926-58a6-471f-a57a-f24fa6628f99 req-a0ac2b01-10db-49e1-88d1-751c518538be service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047600 Mar 08 19:17:13.862457 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 255/517] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:17:13.896685 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:13.903604 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:13.916698 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:13.917456 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:13.919741 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:13.921054 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:13.960711 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-5374c4b0-8c37-481b-ac23-14dd7febd14c req-d7e35077-88fb-4fdb-82f3-ef1d7770424b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d4ea86-f489-4d6d-995e-1999c95b744d", "name": "network-vif-plugged", "status": "completed", "tag": "73344e8e-b327-42b5-a317-814f95b92074"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:13.986048 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-5374c4b0-8c37-481b-ac23-14dd7febd14c req-d7e35077-88fb-4fdb-82f3-ef1d7770424b service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:13.987578 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-5374c4b0-8c37-481b-ac23-14dd7febd14c req-d7e35077-88fb-4fdb-82f3-ef1d7770424b service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:14.031331 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-5374c4b0-8c37-481b-ac23-14dd7febd14c req-d7e35077-88fb-4fdb-82f3-ef1d7770424b service nova] Creating event network-vif-plugged:73344e8e-b327-42b5-a317-814f95b92074 for instance c1d4ea86-f489-4d6d-995e-1999c95b744d on hv-cinder-83009 Mar 08 19:17:14.041454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-5374c4b0-8c37-481b-ac23-14dd7febd14c req-d7e35077-88fb-4fdb-82f3-ef1d7770424b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086193 Mar 08 19:17:14.042752 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 256/518] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:17:14.050671 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-815364660", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eadbce5e-f6fa-402e-acf1-15b1deb0f309"}], "security_groups": [{"name": "tempest-securitygroup--409601523"}], "key_name": "tempest-keypair-128913314", "user_data": "}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:14.257620 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:14.275974 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:14.278156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:14.282066 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f7fe46f6-daa8-4524-ba6c-0f5561faf3da tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1745 microversion: 2.20 time: 0.391541 Mar 08 19:17:14.284656 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 263/519] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:13 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1745 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:14.321376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] validate_networks() for [('eadbce5e-f6fa-402e-acf1-15b1deb0f309', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:17:14.340097 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:14.341034 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:14.355024 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:14.360609 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:14.361709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:14.363188 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:14.478580 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:14.479475 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:14.481158 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lazy-loading 'fault' on Instance uuid 34bb0f82-aeaa-42b9-b40a-c5217b7a2115 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:17:14.601142 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:14.610121 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3ad17bd8-9791-482b-a9e6-30b27e7ea3d1 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 200 len: 1307 microversion: 2.1 time: 0.272525 Mar 08 19:17:14.613960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 264/520] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:14 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 1307 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:14.625497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6f080b58-3003-4c35-ab7a-c53ed6bf505b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:14.626255 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6f080b58-3003-4c35-ab7a-c53ed6bf505b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:14.638354 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6f080b58-3003-4c35-ab7a-c53ed6bf505b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:14.641376 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6f080b58-3003-4c35-ab7a-c53ed6bf505b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:14.645717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6f080b58-3003-4c35-ab7a-c53ed6bf505b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:14.646362 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6f080b58-3003-4c35-ab7a-c53ed6bf505b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:15.033475 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6f080b58-3003-4c35-ab7a-c53ed6bf505b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:15.058423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6f080b58-3003-4c35-ab7a-c53ed6bf505b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.429216 Mar 08 19:17:15.059003 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 265/521] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:14 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:15.071727 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:17:15.072271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:17:15.072888 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:17:15.074357 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:17:15.074357 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:17:15.105772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:15.108194 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:15.111148 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:15.111884 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:15.150609 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:17:15.179733 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:17:15.198476 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:17:15.200919 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:17:15.322561 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:15.325625 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:15.338544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:15.339131 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:15.340248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:15.340739 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:15.381880 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fa03d8d7-5dd8-4abe-a26b-9dbb1327a4c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.337448 Mar 08 19:17:15.382781 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 257/522] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:17:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:17:15.393710 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c5de650a-d196-47f5-a47d-5d92a56a2c9f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:15.394376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c5de650a-d196-47f5-a47d-5d92a56a2c9f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:15.491266 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c5de650a-d196-47f5-a47d-5d92a56a2c9f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:15.502174 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c5de650a-d196-47f5-a47d-5d92a56a2c9f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1240 microversion: 2.1 time: 0.111718 Mar 08 19:17:15.512645 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 258/523] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:15 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1240 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:15.633326 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:15.633902 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 34bb0f82-aeaa-42b9-b40a-c5217b7a2115] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:15.653125 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:15.656761 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:15.661015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:15.662373 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:15.672979 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:15.685558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:15.687159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:15.688232 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a9e136b3-f2a3-46f4-81fc-722ad79cd306 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1745 microversion: 2.20 time: 0.390515 Mar 08 19:17:15.689688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 266/524] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:15 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1745 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:15.726372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] HTTP exception thrown: Instance 34bb0f82-aeaa-42b9-b40a-c5217b7a2115 could not be found. Mar 08 19:17:15.727040 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Returning 404 to user: Instance 34bb0f82-aeaa-42b9-b40a-c5217b7a2115 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:17:15.731032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-adc92821-b749-4299-aa0b-5ebe5142f830 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115" status: 404 len: 111 microversion: 2.1 time: 0.104094 Mar 08 19:17:15.731951 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 259/525] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:15 2022] GET /compute/v2.1/servers/34bb0f82-aeaa-42b9-b40a-c5217b7a2115 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:17:16.069672 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-be30a121-68de-461c-8e0a-d1019d8f37a0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:16.070657 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-be30a121-68de-461c-8e0a-d1019d8f37a0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:16.084724 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-be30a121-68de-461c-8e0a-d1019d8f37a0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:16.098291 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-be30a121-68de-461c-8e0a-d1019d8f37a0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:16.098291 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-be30a121-68de-461c-8e0a-d1019d8f37a0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:16.098291 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-be30a121-68de-461c-8e0a-d1019d8f37a0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:16.440354 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-be30a121-68de-461c-8e0a-d1019d8f37a0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:16.452025 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-be30a121-68de-461c-8e0a-d1019d8f37a0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1725 microversion: 2.1 time: 0.387105 Mar 08 19:17:16.452025 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 267/526] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:16 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1725 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:16.521105 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2f79412e-17d8-4f38-8219-e45084e74565 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:16.521883 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2f79412e-17d8-4f38-8219-e45084e74565 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:16.707288 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:16.708693 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:16.719479 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:16.720508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:16.723900 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:16.724608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:16.730511 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2f79412e-17d8-4f38-8219-e45084e74565 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:16.740060 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2f79412e-17d8-4f38-8219-e45084e74565 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1240 microversion: 2.1 time: 0.223037 Mar 08 19:17:16.745403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 260/527] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:16 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1240 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:17.079799 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:17.092893 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:17.095073 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:17.098153 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-47e12bd4-bebc-4489-8828-e2023bd4bd8a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.395557 Mar 08 19:17:17.101934 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 268/528] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:16 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:17.466554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-174b9e98-01e7-42eb-8430-e20e4e9bee2a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:17.467172 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-174b9e98-01e7-42eb-8430-e20e4e9bee2a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:17.491605 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-174b9e98-01e7-42eb-8430-e20e4e9bee2a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:17.494425 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-174b9e98-01e7-42eb-8430-e20e4e9bee2a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:17.495455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-174b9e98-01e7-42eb-8430-e20e4e9bee2a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:17.503605 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-174b9e98-01e7-42eb-8430-e20e4e9bee2a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:17.725556 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-174b9e98-01e7-42eb-8430-e20e4e9bee2a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:17.742847 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-174b9e98-01e7-42eb-8430-e20e4e9bee2a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1702 microversion: 2.1 time: 0.279876 Mar 08 19:17:17.743337 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 261/529] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:17 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1702 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:17.762626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-93f1e50e-adbd-4e67-b6a4-4d0abf123566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:17.769609 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93f1e50e-adbd-4e67-b6a4-4d0abf123566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:17.771090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93f1e50e-adbd-4e67-b6a4-4d0abf123566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:17.771234 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fe9bcf9a-aa7a-4ece-abc0-d78a5b4a5e51 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:17.771764 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fe9bcf9a-aa7a-4ece-abc0-d78a5b4a5e51 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:17.794653 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fe9bcf9a-aa7a-4ece-abc0-d78a5b4a5e51 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:17.795234 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fe9bcf9a-aa7a-4ece-abc0-d78a5b4a5e51 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:17.796254 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fe9bcf9a-aa7a-4ece-abc0-d78a5b4a5e51 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:17.796969 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fe9bcf9a-aa7a-4ece-abc0-d78a5b4a5e51 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:17.798946 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-93f1e50e-adbd-4e67-b6a4-4d0abf123566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Going to try to start instance {{(pid=117391) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 19:17:17.886322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fe9bcf9a-aa7a-4ece-abc0-d78a5b4a5e51 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:17.901210 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fe9bcf9a-aa7a-4ece-abc0-d78a5b4a5e51 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1244 microversion: 2.1 time: 0.134452 Mar 08 19:17:17.902009 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 262/530] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:17 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1244 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:18.062680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-93f1e50e-adbd-4e67-b6a4-4d0abf123566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/action" status: 202 len: 0 microversion: 2.1 time: 0.305654 Mar 08 19:17:18.063386 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 269/531] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:17:17 2022] POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:17:18.072863 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-451f6cdb-5e63-4c74-8fa2-fa260a92ccb2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:18.073471 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-451f6cdb-5e63-4c74-8fa2-fa260a92ccb2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:18.079892 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-451f6cdb-5e63-4c74-8fa2-fa260a92ccb2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:18.081370 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-451f6cdb-5e63-4c74-8fa2-fa260a92ccb2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:18.082158 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-451f6cdb-5e63-4c74-8fa2-fa260a92ccb2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:18.082802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-451f6cdb-5e63-4c74-8fa2-fa260a92ccb2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:18.118962 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:18.120310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:18.127413 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:18.129381 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:18.130478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:18.131151 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:18.459309 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-451f6cdb-5e63-4c74-8fa2-fa260a92ccb2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:18.467828 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-451f6cdb-5e63-4c74-8fa2-fa260a92ccb2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1711 microversion: 2.1 time: 0.398821 Mar 08 19:17:18.468716 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 263/532] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:18 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1711 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:18.485154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:18.493439 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:18.494946 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:18.496204 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c3c67cd0-5899-4f74-a2aa-05ee7034dfb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.381902 Mar 08 19:17:18.497498 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 270/533] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:18 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:18.921232 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-695ce76f-c7c2-4657-a06b-7b9db139bdd7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:18.922644 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-695ce76f-c7c2-4657-a06b-7b9db139bdd7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:18.931943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-695ce76f-c7c2-4657-a06b-7b9db139bdd7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:18.932589 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-695ce76f-c7c2-4657-a06b-7b9db139bdd7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:18.936332 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-695ce76f-c7c2-4657-a06b-7b9db139bdd7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:18.937136 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-695ce76f-c7c2-4657-a06b-7b9db139bdd7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:19.016084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-695ce76f-c7c2-4657-a06b-7b9db139bdd7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:19.028905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-695ce76f-c7c2-4657-a06b-7b9db139bdd7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1244 microversion: 2.1 time: 0.112673 Mar 08 19:17:19.038806 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 264/534] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:18 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1244 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:19.486109 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8a16f20a-4d2d-49cb-86be-3147ca8fc8a3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:19.487334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8a16f20a-4d2d-49cb-86be-3147ca8fc8a3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:19.496042 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8a16f20a-4d2d-49cb-86be-3147ca8fc8a3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:19.496838 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8a16f20a-4d2d-49cb-86be-3147ca8fc8a3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:19.498315 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8a16f20a-4d2d-49cb-86be-3147ca8fc8a3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:19.498965 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8a16f20a-4d2d-49cb-86be-3147ca8fc8a3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:19.516934 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:19.517518 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:19.525347 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:19.526109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:19.527089 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:19.527759 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:20.150950 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8a16f20a-4d2d-49cb-86be-3147ca8fc8a3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:20.159528 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8a16f20a-4d2d-49cb-86be-3147ca8fc8a3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1711 microversion: 2.1 time: 0.676452 Mar 08 19:17:20.171893 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:20.173054 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 271/535] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:19 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1711 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:20.178891 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8d0de87e-b413-4b54-a178-65f13ac3923b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:20.179840 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8d0de87e-b413-4b54-a178-65f13ac3923b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:20.190804 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:20.193883 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:20.194370 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d0de87e-b413-4b54-a178-65f13ac3923b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:20.195717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d0de87e-b413-4b54-a178-65f13ac3923b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:20.196103 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c92b2449-b0c5-4f3d-a1d2-41a7d6cc3401 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.683328 Mar 08 19:17:20.197373 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 265/536] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:19 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:20.200915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d0de87e-b413-4b54-a178-65f13ac3923b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:20.202558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d0de87e-b413-4b54-a178-65f13ac3923b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:20.289885 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8d0de87e-b413-4b54-a178-65f13ac3923b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:20.297624 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8d0de87e-b413-4b54-a178-65f13ac3923b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1236 microversion: 2.1 time: 0.123171 Mar 08 19:17:20.298210 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 272/537] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:20 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1236 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:21.179671 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0f2ae54d-4c6c-49e3-ac74-71028e1e951b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:21.180949 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0f2ae54d-4c6c-49e3-ac74-71028e1e951b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:21.191082 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0f2ae54d-4c6c-49e3-ac74-71028e1e951b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:21.192044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0f2ae54d-4c6c-49e3-ac74-71028e1e951b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:21.193249 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0f2ae54d-4c6c-49e3-ac74-71028e1e951b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:21.193690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0f2ae54d-4c6c-49e3-ac74-71028e1e951b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:21.215348 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:21.216059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:21.227700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:21.229276 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:21.231409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:21.234806 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:21.613925 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0f2ae54d-4c6c-49e3-ac74-71028e1e951b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:21.624774 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:21.633235 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:21.636404 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:21.644417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-14f72134-0ace-4e51-a639-a497a804963b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.424976 Mar 08 19:17:21.646037 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0f2ae54d-4c6c-49e3-ac74-71028e1e951b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1711 microversion: 2.1 time: 0.470274 Mar 08 19:17:21.654921 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 273/538] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:21 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:21.665267 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 266/539] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:21 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1711 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:21.665422 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-714405fd-d302-4b09-bbd1-ddc8a7c41fb4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:21.665422 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-714405fd-d302-4b09-bbd1-ddc8a7c41fb4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:21.679001 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-714405fd-d302-4b09-bbd1-ddc8a7c41fb4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:21.679451 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-714405fd-d302-4b09-bbd1-ddc8a7c41fb4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:21.680312 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-714405fd-d302-4b09-bbd1-ddc8a7c41fb4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:21.680768 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-714405fd-d302-4b09-bbd1-ddc8a7c41fb4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:21.777339 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-714405fd-d302-4b09-bbd1-ddc8a7c41fb4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:21.791298 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-714405fd-d302-4b09-bbd1-ddc8a7c41fb4 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1292 microversion: 2.1 time: 0.134556 Mar 08 19:17:21.791298 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 274/540] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:21 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1292 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:22.663418 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ee53314e-e3f8-40cb-a9f7-233809cfafc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:22.664751 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ee53314e-e3f8-40cb-a9f7-233809cfafc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:22.670756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:22.671559 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:22.681260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:22.681980 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:22.682958 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:22.683841 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:22.689367 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ee53314e-e3f8-40cb-a9f7-233809cfafc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:22.689367 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ee53314e-e3f8-40cb-a9f7-233809cfafc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:22.689367 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ee53314e-e3f8-40cb-a9f7-233809cfafc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:22.708500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ee53314e-e3f8-40cb-a9f7-233809cfafc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:23.156521 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:23.178189 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:23.200584 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:23.201928 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e4848073-3779-42e9-bff6-f878d0b7e4b3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.540421 Mar 08 19:17:23.207869 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 275/541] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:22 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:23.209229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ee53314e-e3f8-40cb-a9f7-233809cfafc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:23.217579 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e05d5534-817e-4dc3-95b7-d63659e29c28 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:23.220176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e05d5534-817e-4dc3-95b7-d63659e29c28 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:23.227112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ee53314e-e3f8-40cb-a9f7-233809cfafc4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1711 microversion: 2.1 time: 0.565464 Mar 08 19:17:23.227112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 267/542] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:22 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1711 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:23.238260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e05d5534-817e-4dc3-95b7-d63659e29c28 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:23.244040 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e05d5534-817e-4dc3-95b7-d63659e29c28 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:23.245032 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e05d5534-817e-4dc3-95b7-d63659e29c28 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:23.245497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e05d5534-817e-4dc3-95b7-d63659e29c28 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:23.363306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e05d5534-817e-4dc3-95b7-d63659e29c28 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:23.369487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e05d5534-817e-4dc3-95b7-d63659e29c28 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1298 microversion: 2.1 time: 0.160144 Mar 08 19:17:23.370263 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 276/543] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:23 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1298 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:24.227097 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:24.234001 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:24.246027 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:24.246651 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:24.247148 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1dca16dd-ad74-4702-ba14-646764429da7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:24.247624 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:24.247773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1dca16dd-ad74-4702-ba14-646764429da7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:24.248005 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:24.259890 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1dca16dd-ad74-4702-ba14-646764429da7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:24.269916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1dca16dd-ad74-4702-ba14-646764429da7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:24.272633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1dca16dd-ad74-4702-ba14-646764429da7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:24.273890 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1dca16dd-ad74-4702-ba14-646764429da7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:24.870397 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1dca16dd-ad74-4702-ba14-646764429da7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:24.870816 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:24.883473 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:24.884870 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1dca16dd-ad74-4702-ba14-646764429da7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1715 microversion: 2.1 time: 0.643113 Mar 08 19:17:24.885016 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:24.886504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fa081d32-b8df-410f-91fb-89f2f847f6be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.667515 Mar 08 19:17:24.898995 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 268/544] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:24 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:24.904592 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 277/545] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:24 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1715 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:24.904811 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a95c63b3-4046-42db-b76d-e89b0fb7db4e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:24.905590 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a95c63b3-4046-42db-b76d-e89b0fb7db4e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:24.912674 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a95c63b3-4046-42db-b76d-e89b0fb7db4e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:24.913158 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a95c63b3-4046-42db-b76d-e89b0fb7db4e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:24.913940 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a95c63b3-4046-42db-b76d-e89b0fb7db4e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:24.914374 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a95c63b3-4046-42db-b76d-e89b0fb7db4e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:25.398171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a95c63b3-4046-42db-b76d-e89b0fb7db4e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:25.409578 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a95c63b3-4046-42db-b76d-e89b0fb7db4e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.509177 Mar 08 19:17:25.415754 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 269/546] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:24 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:25.906069 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:25.908838 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:25.932440 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:25.934333 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:25.942699 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:25.943740 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:26.432437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-70a61dbf-3105-492c-9c0b-914acb729322 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:26.434114 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-70a61dbf-3105-492c-9c0b-914acb729322 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:26.445378 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-70a61dbf-3105-492c-9c0b-914acb729322 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:26.446140 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-70a61dbf-3105-492c-9c0b-914acb729322 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:26.447007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-70a61dbf-3105-492c-9c0b-914acb729322 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:26.447445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-70a61dbf-3105-492c-9c0b-914acb729322 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:26.608214 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:26.619013 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:26.621078 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:26.622493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4641ec36-004d-436f-bda6-39aa331639f9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.720426 Mar 08 19:17:26.623567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 278/547] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:25 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:26.629275 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-70612d68-c60f-4874-8687-44197f64d96b req-a25d2f10-fce6-4324-abd6-ca20badd07b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8644e465-6137-4694-97d5-5348bc14e92b", "tag": "d24e8526-b0cb-4096-8754-39963dbac7a3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:26.645391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-70612d68-c60f-4874-8687-44197f64d96b req-a25d2f10-fce6-4324-abd6-ca20badd07b3 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:26.646097 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-70612d68-c60f-4874-8687-44197f64d96b req-a25d2f10-fce6-4324-abd6-ca20badd07b3 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:26.662333 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-70612d68-c60f-4874-8687-44197f64d96b req-a25d2f10-fce6-4324-abd6-ca20badd07b3 service nova] Creating event network-changed:d24e8526-b0cb-4096-8754-39963dbac7a3 for instance 8644e465-6137-4694-97d5-5348bc14e92b on hv-cinder-83009 Mar 08 19:17:26.669881 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-70612d68-c60f-4874-8687-44197f64d96b req-a25d2f10-fce6-4324-abd6-ca20badd07b3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043515 Mar 08 19:17:26.671141 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 279/548] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:17:26.710906 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-70a61dbf-3105-492c-9c0b-914acb729322 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:26.724634 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-70a61dbf-3105-492c-9c0b-914acb729322 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.295980 Mar 08 19:17:26.725561 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 270/549] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:26 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:27.644076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:27.645508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:27.654888 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:27.655336 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:27.656358 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:27.656958 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:27.741471 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a21eb311-075b-48a9-bb69-663aeb1f62b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:27.743807 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a21eb311-075b-48a9-bb69-663aeb1f62b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:27.750486 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a21eb311-075b-48a9-bb69-663aeb1f62b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:27.751264 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a21eb311-075b-48a9-bb69-663aeb1f62b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:27.752188 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a21eb311-075b-48a9-bb69-663aeb1f62b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:27.752845 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a21eb311-075b-48a9-bb69-663aeb1f62b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:27.856273 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:27.869520 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:27.871394 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:27.873318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d738c740-b93e-40be-840c-16d5355feea0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.234614 Mar 08 19:17:27.874221 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 280/550] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:27 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:27.941929 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a21eb311-075b-48a9-bb69-663aeb1f62b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:27.950114 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a21eb311-075b-48a9-bb69-663aeb1f62b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.212556 Mar 08 19:17:27.950711 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 271/551] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:27 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:28.893944 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:28.894832 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:28.901371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:28.901824 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:28.902588 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:28.903017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:28.966555 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-46b25561-72c8-4d7c-aaa6-4ebfe899a914 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:28.967809 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-46b25561-72c8-4d7c-aaa6-4ebfe899a914 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:28.975617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-46b25561-72c8-4d7c-aaa6-4ebfe899a914 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:28.976883 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-46b25561-72c8-4d7c-aaa6-4ebfe899a914 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:28.977879 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-46b25561-72c8-4d7c-aaa6-4ebfe899a914 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:28.979079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-46b25561-72c8-4d7c-aaa6-4ebfe899a914 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:29.145189 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:29.153760 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:29.163310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:29.167133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cc76c8a0-395f-4e4e-b8cc-7494ee5c9155 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.277753 Mar 08 19:17:29.168080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 281/552] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:28 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:29.248356 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-46b25561-72c8-4d7c-aaa6-4ebfe899a914 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:29.257723 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-46b25561-72c8-4d7c-aaa6-4ebfe899a914 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.294876 Mar 08 19:17:29.258618 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 272/553] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:28 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:30.185952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:30.186627 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:30.193966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:30.194431 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:30.195200 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:30.195633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:30.274777 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-47e635b8-2e65-4ac4-a1a6-c87629c38138 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:30.275382 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-47e635b8-2e65-4ac4-a1a6-c87629c38138 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:30.281746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47e635b8-2e65-4ac4-a1a6-c87629c38138 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:30.282247 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47e635b8-2e65-4ac4-a1a6-c87629c38138 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:30.283003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47e635b8-2e65-4ac4-a1a6-c87629c38138 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:30.284013 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47e635b8-2e65-4ac4-a1a6-c87629c38138 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:30.359416 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:30.368890 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:30.370424 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:30.371652 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d8cf5171-e9a3-4c45-bb3a-de1bfcccc42e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1740 microversion: 2.20 time: 0.189811 Mar 08 19:17:30.373262 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 282/554] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:30 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:30.451537 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-47e635b8-2e65-4ac4-a1a6-c87629c38138 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:30.459662 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-47e635b8-2e65-4ac4-a1a6-c87629c38138 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.188695 Mar 08 19:17:30.460458 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 273/555] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:30 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:30.563402 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-21680765", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "networks": [{"uuid": "3eaa1a64-1730-4b60-97b5-c1f5e0ba8463"}]}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:30.615779 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] validate_networks() for [('3eaa1a64-1730-4b60-97b5-c1f5e0ba8463', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:17:31.017170 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:17:31.017586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:17:31.018156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:17:31.018630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:17:31.019039 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:17:31.027938 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:31.028665 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:31.029635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:31.030247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:31.053789 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Getting quotas for project f10261552daf4cb9a0cf1b53cb019b42. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:17:31.058519 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Getting quotas for user b56bbaadcca041fe89e65bfb79526a8d and project f10261552daf4cb9a0cf1b53cb019b42. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:17:31.074949 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:17:31.077729 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:17:31.240702 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ca294799-2b69-427b-bad1-8d0b52bab46c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.681124 Mar 08 19:17:31.241745 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 283/556] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:17:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 19:17:31.255738 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-04e90cd1-3f5d-4778-a5d5-53fd3d0136f2 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:31.256497 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-04e90cd1-3f5d-4778-a5d5-53fd3d0136f2 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:31.320767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-04e90cd1-3f5d-4778-a5d5-53fd3d0136f2 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:31.329664 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-04e90cd1-3f5d-4778-a5d5-53fd3d0136f2 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1217 microversion: 2.1 time: 0.077072 Mar 08 19:17:31.331638 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 274/557] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:31 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1217 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:31.395652 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:31.396644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:31.415490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:31.415490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:31.415490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:31.415490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:31.483561 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-43d39964-036c-43c0-b9e2-fdc46fecbdd3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:31.484597 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-43d39964-036c-43c0-b9e2-fdc46fecbdd3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:31.492994 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43d39964-036c-43c0-b9e2-fdc46fecbdd3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:31.493684 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43d39964-036c-43c0-b9e2-fdc46fecbdd3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:31.494791 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43d39964-036c-43c0-b9e2-fdc46fecbdd3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:31.495401 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43d39964-036c-43c0-b9e2-fdc46fecbdd3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:31.809966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:31.815962 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-43d39964-036c-43c0-b9e2-fdc46fecbdd3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:31.819003 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:31.820567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:31.821754 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-79e02356-f8c0-49f2-ad20-819cb458828c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1722 microversion: 2.20 time: 0.432947 Mar 08 19:17:31.822313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 284/558] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:31 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:31.823730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-43d39964-036c-43c0-b9e2-fdc46fecbdd3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.346341 Mar 08 19:17:31.824321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 275/559] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:31 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:32.346971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9726f967-b3a7-4955-bf2e-93f41413da88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:32.347599 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9726f967-b3a7-4955-bf2e-93f41413da88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:32.354010 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9726f967-b3a7-4955-bf2e-93f41413da88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:32.354458 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9726f967-b3a7-4955-bf2e-93f41413da88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:32.355218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9726f967-b3a7-4955-bf2e-93f41413da88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:32.355643 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9726f967-b3a7-4955-bf2e-93f41413da88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:32.421558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9726f967-b3a7-4955-bf2e-93f41413da88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:32.429634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9726f967-b3a7-4955-bf2e-93f41413da88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1221 microversion: 2.1 time: 0.087182 Mar 08 19:17:32.434952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 285/560] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:32 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:32.841521 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-208aa188-c76b-4905-82ab-205828ee7da2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:32.842002 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:32.842469 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-208aa188-c76b-4905-82ab-205828ee7da2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:32.842951 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:32.849168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-208aa188-c76b-4905-82ab-205828ee7da2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:32.851526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-208aa188-c76b-4905-82ab-205828ee7da2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:32.851526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-208aa188-c76b-4905-82ab-205828ee7da2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:32.851526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-208aa188-c76b-4905-82ab-205828ee7da2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:32.852235 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:32.852763 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:32.853690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:32.854234 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:33.073129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-208aa188-c76b-4905-82ab-205828ee7da2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:33.076820 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:33.090018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-208aa188-c76b-4905-82ab-205828ee7da2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.252156 Mar 08 19:17:33.090520 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:33.092252 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:33.093343 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-816e502c-f3ba-4f7f-b446-b438e34a4448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1722 microversion: 2.20 time: 0.256358 Mar 08 19:17:33.094027 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 286/561] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:32 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:33.105558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 276/562] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:32 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:33.447057 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-63ef56f6-a63e-44e5-9259-d1800c82baae tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:33.447801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-63ef56f6-a63e-44e5-9259-d1800c82baae tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:33.454349 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-63ef56f6-a63e-44e5-9259-d1800c82baae tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:33.454926 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-63ef56f6-a63e-44e5-9259-d1800c82baae tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:33.456617 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-63ef56f6-a63e-44e5-9259-d1800c82baae tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:33.457156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-63ef56f6-a63e-44e5-9259-d1800c82baae tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:33.540287 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-63ef56f6-a63e-44e5-9259-d1800c82baae tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:33.553020 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-63ef56f6-a63e-44e5-9259-d1800c82baae tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1277 microversion: 2.1 time: 0.109883 Mar 08 19:17:33.553608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 287/563] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:33 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:34.112680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:34.113285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:34.116933 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2a921a0b-bff1-4dd0-a48a-e2c18e75b38e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:34.119099 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2a921a0b-bff1-4dd0-a48a-e2c18e75b38e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:34.120543 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:34.120993 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:34.121949 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:34.132384 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:34.147958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2a921a0b-bff1-4dd0-a48a-e2c18e75b38e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:34.148719 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2a921a0b-bff1-4dd0-a48a-e2c18e75b38e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:34.150125 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2a921a0b-bff1-4dd0-a48a-e2c18e75b38e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:34.150934 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2a921a0b-bff1-4dd0-a48a-e2c18e75b38e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:34.512315 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:34.520703 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2a921a0b-bff1-4dd0-a48a-e2c18e75b38e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:34.520907 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:34.522395 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:34.523564 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1aaac296-38be-4579-ac9a-68bb561362a7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1722 microversion: 2.20 time: 0.415249 Mar 08 19:17:34.524174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 288/564] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:34 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:34.530307 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2a921a0b-bff1-4dd0-a48a-e2c18e75b38e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.421402 Mar 08 19:17:34.530950 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 277/565] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:34 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:34.573602 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f9dfe9f8-18c8-4fc3-8259-10d2316352bf tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:34.574214 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f9dfe9f8-18c8-4fc3-8259-10d2316352bf tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:34.580074 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f9dfe9f8-18c8-4fc3-8259-10d2316352bf tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:34.580813 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f9dfe9f8-18c8-4fc3-8259-10d2316352bf tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:34.581632 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f9dfe9f8-18c8-4fc3-8259-10d2316352bf tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:34.582070 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f9dfe9f8-18c8-4fc3-8259-10d2316352bf tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:34.884533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f9dfe9f8-18c8-4fc3-8259-10d2316352bf tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:34.892529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f9dfe9f8-18c8-4fc3-8259-10d2316352bf tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.323014 Mar 08 19:17:34.893419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 289/566] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:34 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:35.221722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-9ce995a5-c6b4-4a03-b957-c8af0b4210d5 req-27ea9675-b5f0-4829-ba47-dfa3857edf72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8644e465-6137-4694-97d5-5348bc14e92b", "name": "network-vif-plugged", "status": "completed", "tag": "d24e8526-b0cb-4096-8754-39963dbac7a3"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:35.230943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-9ce995a5-c6b4-4a03-b957-c8af0b4210d5 req-27ea9675-b5f0-4829-ba47-dfa3857edf72 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.231470 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-9ce995a5-c6b4-4a03-b957-c8af0b4210d5 req-27ea9675-b5f0-4829-ba47-dfa3857edf72 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.243195 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-9ce995a5-c6b4-4a03-b957-c8af0b4210d5 req-27ea9675-b5f0-4829-ba47-dfa3857edf72 service nova] Creating event network-vif-plugged:d24e8526-b0cb-4096-8754-39963dbac7a3 for instance 8644e465-6137-4694-97d5-5348bc14e92b on hv-cinder-83009 Mar 08 19:17:35.248537 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-9ce995a5-c6b4-4a03-b957-c8af0b4210d5 req-27ea9675-b5f0-4829-ba47-dfa3857edf72 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031452 Mar 08 19:17:35.249129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 278/567] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:17:35.410134 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-a8107ad6-7900-49d8-83d2-d8d93344da91 req-b1fb272f-8603-4fa1-93c4-f8306916efec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c05a596-08f8-4d79-b15c-01475fa474d5", "tag": "604c84cd-7106-455e-a449-d54438924a60"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:35.422688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-a8107ad6-7900-49d8-83d2-d8d93344da91 req-b1fb272f-8603-4fa1-93c4-f8306916efec service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.424999 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-a8107ad6-7900-49d8-83d2-d8d93344da91 req-b1fb272f-8603-4fa1-93c4-f8306916efec service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.439679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-a8107ad6-7900-49d8-83d2-d8d93344da91 req-b1fb272f-8603-4fa1-93c4-f8306916efec service nova] Creating event network-changed:604c84cd-7106-455e-a449-d54438924a60 for instance 8c05a596-08f8-4d79-b15c-01475fa474d5 on hv-cinder-83009 Mar 08 19:17:35.445667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-a8107ad6-7900-49d8-83d2-d8d93344da91 req-b1fb272f-8603-4fa1-93c4-f8306916efec service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040235 Mar 08 19:17:35.446672 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 290/568] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:17:35.542557 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:35.543531 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:35.548173 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cebfd2a1-da6e-43c9-9a42-bcab4634940f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:35.550426 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cebfd2a1-da6e-43c9-9a42-bcab4634940f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:35.550867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.551324 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.552195 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.552827 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.558144 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cebfd2a1-da6e-43c9-9a42-bcab4634940f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.558680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cebfd2a1-da6e-43c9-9a42-bcab4634940f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.559541 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cebfd2a1-da6e-43c9-9a42-bcab4634940f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.560359 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cebfd2a1-da6e-43c9-9a42-bcab4634940f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.937685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:35.944469 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cebfd2a1-da6e-43c9-9a42-bcab4634940f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:35.951490 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:35.953048 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:35.956985 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-942f2343-7079-4c13-aa7a-b5d8891dd887 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1665 microversion: 2.20 time: 0.416477 Mar 08 19:17:35.956985 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 279/569] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:35 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1665 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:35.960334 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8e502c78-3bc5-453a-a8d8-00f7f25b7283 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:35.960943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8e502c78-3bc5-453a-a8d8-00f7f25b7283 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:35.969100 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cebfd2a1-da6e-43c9-9a42-bcab4634940f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.425296 Mar 08 19:17:35.969679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 291/570] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:35 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:35.974863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6aee4685-fd68-4a0d-8240-0973b95d3aa0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a3ecb9-ba3d-4fd3-bf30-fe6a069f1fc2"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:35.975959 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6aee4685-fd68-4a0d-8240-0973b95d3aa0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:35.981558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8e502c78-3bc5-453a-a8d8-00f7f25b7283 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.982011 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8e502c78-3bc5-453a-a8d8-00f7f25b7283 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.982785 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8e502c78-3bc5-453a-a8d8-00f7f25b7283 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.983217 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8e502c78-3bc5-453a-a8d8-00f7f25b7283 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.990961 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6aee4685-fd68-4a0d-8240-0973b95d3aa0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.991411 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6aee4685-fd68-4a0d-8240-0973b95d3aa0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:35.992215 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6aee4685-fd68-4a0d-8240-0973b95d3aa0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:35.992653 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6aee4685-fd68-4a0d-8240-0973b95d3aa0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:36.125077 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8e502c78-3bc5-453a-a8d8-00f7f25b7283 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:36.132419 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8e502c78-3bc5-453a-a8d8-00f7f25b7283 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.175685 Mar 08 19:17:36.132973 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 280/571] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:35 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:36.985559 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-396975e4-682b-477a-a671-d959111dfca0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:36.986213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-396975e4-682b-477a-a671-d959111dfca0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:36.996138 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-396975e4-682b-477a-a671-d959111dfca0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:36.996138 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-396975e4-682b-477a-a671-d959111dfca0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:36.996938 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-396975e4-682b-477a-a671-d959111dfca0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:36.997375 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-396975e4-682b-477a-a671-d959111dfca0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:37.135154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-396975e4-682b-477a-a671-d959111dfca0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:37.144760 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-396975e4-682b-477a-a671-d959111dfca0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1365 microversion: 2.1 time: 0.161112 Mar 08 19:17:37.144760 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 281/572] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:36 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:37.150373 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-320b22ca-1543-4451-8525-417b191b0db4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:37.152477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-320b22ca-1543-4451-8525-417b191b0db4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:37.160170 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-320b22ca-1543-4451-8525-417b191b0db4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:37.160875 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-320b22ca-1543-4451-8525-417b191b0db4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:37.161644 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-320b22ca-1543-4451-8525-417b191b0db4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:37.162072 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-320b22ca-1543-4451-8525-417b191b0db4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:37.231834 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6aee4685-fd68-4a0d-8240-0973b95d3aa0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.260967 Mar 08 19:17:37.232404 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 292/573] 10.222.0.75 () {62 vars in 1363 bytes} [Tue Mar 8 19:17:35 2022] POST /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments => generated 188 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:17:37.263846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-f173e3e3-3381-41f1-a098-c55849f2eede req-181b704b-c0e6-4dc7-b041-bd21248836f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d4ea86-f489-4d6d-995e-1999c95b744d", "name": "network-vif-unplugged", "status": "completed", "tag": "73344e8e-b327-42b5-a317-814f95b92074"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:37.275021 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-f173e3e3-3381-41f1-a098-c55849f2eede req-181b704b-c0e6-4dc7-b041-bd21248836f9 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:37.275551 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-f173e3e3-3381-41f1-a098-c55849f2eede req-181b704b-c0e6-4dc7-b041-bd21248836f9 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:37.289846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.compute.server_external_events [req-f173e3e3-3381-41f1-a098-c55849f2eede req-181b704b-c0e6-4dc7-b041-bd21248836f9 service nova] Unable to find a host for instance c1d4ea86-f489-4d6d-995e-1999c95b744d. Dropping event network-vif-unplugged {{(pid=117391) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 08 19:17:37.290892 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-f173e3e3-3381-41f1-a098-c55849f2eede req-181b704b-c0e6-4dc7-b041-bd21248836f9 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031421 Mar 08 19:17:37.292226 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 293/574] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 08 19:17:37.365976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3e7dfd1b-ebcf-43ed-82c1-039846fe6119 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:37.366560 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3e7dfd1b-ebcf-43ed-82c1-039846fe6119 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:37.372867 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3e7dfd1b-ebcf-43ed-82c1-039846fe6119 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:37.373323 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3e7dfd1b-ebcf-43ed-82c1-039846fe6119 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:37.374140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3e7dfd1b-ebcf-43ed-82c1-039846fe6119 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:37.374581 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3e7dfd1b-ebcf-43ed-82c1-039846fe6119 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:37.540201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-320b22ca-1543-4451-8525-417b191b0db4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:37.547497 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-320b22ca-1543-4451-8525-417b191b0db4 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.401290 Mar 08 19:17:37.548092 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 282/575] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:37 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:37.823756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3e7dfd1b-ebcf-43ed-82c1-039846fe6119 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/action" status: 202 len: 0 microversion: 2.20 time: 0.462289 Mar 08 19:17:37.824544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 294/576] 10.222.0.75 () {62 vars in 1318 bytes} [Tue Mar 8 19:17:37 2022] POST /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 08 19:17:37.833949 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:37.834593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:37.840714 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:37.841340 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:37.848251 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:37.848251 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:37.983119 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:37.992250 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:37.993791 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:37.994994 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4fd575c7-1f4f-4da5-aa3e-8365666c8958 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1751 microversion: 2.20 time: 0.166259 Mar 08 19:17:37.995554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 283/577] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:37 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:38.159593 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cc19a92a-e47a-4bc2-a382-ff44e0dff08c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:38.160352 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cc19a92a-e47a-4bc2-a382-ff44e0dff08c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:38.167081 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cc19a92a-e47a-4bc2-a382-ff44e0dff08c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:38.167600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cc19a92a-e47a-4bc2-a382-ff44e0dff08c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:38.168462 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cc19a92a-e47a-4bc2-a382-ff44e0dff08c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:38.168981 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cc19a92a-e47a-4bc2-a382-ff44e0dff08c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:38.309508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cc19a92a-e47a-4bc2-a382-ff44e0dff08c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:38.317678 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cc19a92a-e47a-4bc2-a382-ff44e0dff08c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1555 microversion: 2.1 time: 0.161905 Mar 08 19:17:38.320690 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 295/578] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:38 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:38.351618 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-969db248-144b-483a-9ede-13c37074a078 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:38.352091 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-969db248-144b-483a-9ede-13c37074a078 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:38.358251 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-969db248-144b-483a-9ede-13c37074a078 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:38.358700 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-969db248-144b-483a-9ede-13c37074a078 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:38.359455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-969db248-144b-483a-9ede-13c37074a078 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:38.359886 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-969db248-144b-483a-9ede-13c37074a078 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:38.448316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-969db248-144b-483a-9ede-13c37074a078 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100594 Mar 08 19:17:38.448933 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 284/579] 10.222.0.75 () {58 vars in 1274 bytes} [Tue Mar 8 19:17:38 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:17:38.566287 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a91f9191-0bc2-4c67-b61c-dce78df58218 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:38.566965 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a91f9191-0bc2-4c67-b61c-dce78df58218 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:38.573448 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a91f9191-0bc2-4c67-b61c-dce78df58218 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:38.573908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a91f9191-0bc2-4c67-b61c-dce78df58218 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:38.574686 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a91f9191-0bc2-4c67-b61c-dce78df58218 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:38.575122 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a91f9191-0bc2-4c67-b61c-dce78df58218 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:38.882090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a91f9191-0bc2-4c67-b61c-dce78df58218 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:38.890401 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a91f9191-0bc2-4c67-b61c-dce78df58218 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.328722 Mar 08 19:17:38.901247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 296/580] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:38 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:39.018762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:39.018762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:39.025403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:39.025968 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:39.026999 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:39.027559 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:39.261297 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:39.270182 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:39.271694 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:39.272922 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-48727965-1e12-49d7-a668-d56a543786e3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1751 microversion: 2.20 time: 0.263931 Mar 08 19:17:39.273472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 285/581] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:39 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:39.687451 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-a7d30eb2-d318-44eb-8dd4-46e2521199a5 req-289193cf-a2d7-451b-a1e7-835eb7879ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8644e465-6137-4694-97d5-5348bc14e92b", "tag": "d24e8526-b0cb-4096-8754-39963dbac7a3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:39.697224 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-a7d30eb2-d318-44eb-8dd4-46e2521199a5 req-289193cf-a2d7-451b-a1e7-835eb7879ce7 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:39.697755 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-a7d30eb2-d318-44eb-8dd4-46e2521199a5 req-289193cf-a2d7-451b-a1e7-835eb7879ce7 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:39.709599 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-a7d30eb2-d318-44eb-8dd4-46e2521199a5 req-289193cf-a2d7-451b-a1e7-835eb7879ce7 service nova] Creating event network-changed:d24e8526-b0cb-4096-8754-39963dbac7a3 for instance 8644e465-6137-4694-97d5-5348bc14e92b on hv-cinder-83009 Mar 08 19:17:39.715756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-a7d30eb2-d318-44eb-8dd4-46e2521199a5 req-289193cf-a2d7-451b-a1e7-835eb7879ce7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034785 Mar 08 19:17:39.716169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 297/582] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:17:39.908767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d889a6df-af01-4c08-bec2-7b93130d87fb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:39.909450 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d889a6df-af01-4c08-bec2-7b93130d87fb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:39.916398 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d889a6df-af01-4c08-bec2-7b93130d87fb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:39.919837 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d889a6df-af01-4c08-bec2-7b93130d87fb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:39.919837 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d889a6df-af01-4c08-bec2-7b93130d87fb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:39.919837 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d889a6df-af01-4c08-bec2-7b93130d87fb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:40.139420 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d889a6df-af01-4c08-bec2-7b93130d87fb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:40.149770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d889a6df-af01-4c08-bec2-7b93130d87fb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.245493 Mar 08 19:17:40.151087 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 286/583] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:39 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:40.293634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:40.294551 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:40.300987 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:40.301726 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:40.303283 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:40.303283 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:40.469192 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:40.479093 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:40.483306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:40.485113 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-58a896db-e2b6-4db8-8db4-b64f58011cab tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1753 microversion: 2.20 time: 0.196512 Mar 08 19:17:40.485688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 298/584] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:40 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1753 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:41.168703 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-90520d82-256a-450b-8770-f72dc84ff4bd tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:41.169314 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-90520d82-256a-450b-8770-f72dc84ff4bd tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:41.176986 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-90520d82-256a-450b-8770-f72dc84ff4bd tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:41.177819 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-90520d82-256a-450b-8770-f72dc84ff4bd tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:41.178203 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-90520d82-256a-450b-8770-f72dc84ff4bd tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:41.178633 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-90520d82-256a-450b-8770-f72dc84ff4bd tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:41.339409 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-90520d82-256a-450b-8770-f72dc84ff4bd tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:41.348104 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-90520d82-256a-450b-8770-f72dc84ff4bd tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.183180 Mar 08 19:17:41.348689 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 287/585] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:41 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:41.504745 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:41.505261 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:41.511769 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:41.512281 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:41.513052 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:41.513488 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:41.659697 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:41.669167 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:41.670703 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:41.671872 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4d9ab447-0bbd-491f-b68f-99657e1b97eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.171853 Mar 08 19:17:41.672455 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 299/586] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:41 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:42.365971 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-00b9499a-fc2b-4fe8-8263-66371374ab8f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:42.366649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-00b9499a-fc2b-4fe8-8263-66371374ab8f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:42.373225 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-00b9499a-fc2b-4fe8-8263-66371374ab8f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:42.373677 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-00b9499a-fc2b-4fe8-8263-66371374ab8f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:42.374456 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-00b9499a-fc2b-4fe8-8263-66371374ab8f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:42.374894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-00b9499a-fc2b-4fe8-8263-66371374ab8f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:42.694045 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:42.694735 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:42.702015 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:42.702491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:42.703321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:42.703696 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:42.756597 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-00b9499a-fc2b-4fe8-8263-66371374ab8f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:42.764213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-00b9499a-fc2b-4fe8-8263-66371374ab8f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.402867 Mar 08 19:17:42.764877 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 288/587] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:42 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:42.858209 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:42.866671 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:42.868243 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:42.869395 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fcdffbce-9c35-4b49-b289-94c6e1dfc4a6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.182559 Mar 08 19:17:42.870239 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 300/588] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:42 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:43.296831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-76a3ad53-1e7a-4c4f-a05f-f02cb9e954d1 req-d0ce30c5-3839-46f9-8079-8f6cfa1b4e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c05a596-08f8-4d79-b15c-01475fa474d5", "name": "network-vif-plugged", "status": "completed", "tag": "604c84cd-7106-455e-a449-d54438924a60"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:43.306314 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-76a3ad53-1e7a-4c4f-a05f-f02cb9e954d1 req-d0ce30c5-3839-46f9-8079-8f6cfa1b4e2e service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:43.306823 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-76a3ad53-1e7a-4c4f-a05f-f02cb9e954d1 req-d0ce30c5-3839-46f9-8079-8f6cfa1b4e2e service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:43.319613 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-76a3ad53-1e7a-4c4f-a05f-f02cb9e954d1 req-d0ce30c5-3839-46f9-8079-8f6cfa1b4e2e service nova] Creating event network-vif-plugged:604c84cd-7106-455e-a449-d54438924a60 for instance 8c05a596-08f8-4d79-b15c-01475fa474d5 on hv-cinder-83009 Mar 08 19:17:43.325007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-76a3ad53-1e7a-4c4f-a05f-f02cb9e954d1 req-d0ce30c5-3839-46f9-8079-8f6cfa1b4e2e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031846 Mar 08 19:17:43.325822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 289/589] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:17:43.786876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d855e0eb-eb6f-46bb-a922-0d253b9041a9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:43.786876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d855e0eb-eb6f-46bb-a922-0d253b9041a9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:43.810154 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d855e0eb-eb6f-46bb-a922-0d253b9041a9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:43.810750 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d855e0eb-eb6f-46bb-a922-0d253b9041a9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:43.811778 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d855e0eb-eb6f-46bb-a922-0d253b9041a9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:43.812414 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d855e0eb-eb6f-46bb-a922-0d253b9041a9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:43.889398 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:43.890270 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:43.904262 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:43.904892 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:43.905831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:43.906464 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:43.966278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d855e0eb-eb6f-46bb-a922-0d253b9041a9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:43.975867 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d855e0eb-eb6f-46bb-a922-0d253b9041a9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.195937 Mar 08 19:17:43.981346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 301/590] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:43 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:44.090681 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:44.102247 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:44.103902 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:44.105317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ceef9da1-520a-487b-a2fa-9190835a157b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.220587 Mar 08 19:17:44.105881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 290/591] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:43 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:44.997910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2efad9ce-6006-4096-bf73-60d7513d2f2e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:44.998584 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2efad9ce-6006-4096-bf73-60d7513d2f2e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:45.005013 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2efad9ce-6006-4096-bf73-60d7513d2f2e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:45.005457 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2efad9ce-6006-4096-bf73-60d7513d2f2e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:45.006256 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2efad9ce-6006-4096-bf73-60d7513d2f2e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:45.006759 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2efad9ce-6006-4096-bf73-60d7513d2f2e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:45.133975 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:45.135853 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:45.144353 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:45.145043 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:45.145984 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:45.146575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:45.175214 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2efad9ce-6006-4096-bf73-60d7513d2f2e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:45.185104 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2efad9ce-6006-4096-bf73-60d7513d2f2e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.191080 Mar 08 19:17:45.185946 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 302/592] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:44 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:45.326927 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:45.335906 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:45.337768 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:45.338969 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-cb70883a-53ca-476b-9e41-8ed8b0735fa1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.215714 Mar 08 19:17:45.339535 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 291/593] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:45 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:46.202734 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e0121545-566f-4ff4-b53d-fe48883bcbf5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:46.203418 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e0121545-566f-4ff4-b53d-fe48883bcbf5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:46.213329 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e0121545-566f-4ff4-b53d-fe48883bcbf5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:46.214381 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e0121545-566f-4ff4-b53d-fe48883bcbf5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:46.215496 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e0121545-566f-4ff4-b53d-fe48883bcbf5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:46.215962 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e0121545-566f-4ff4-b53d-fe48883bcbf5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:46.358049 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:46.359333 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:46.367070 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:46.367526 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:46.368575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:46.369009 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:46.397230 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e0121545-566f-4ff4-b53d-fe48883bcbf5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:46.404761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e0121545-566f-4ff4-b53d-fe48883bcbf5 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.205820 Mar 08 19:17:46.414164 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 303/594] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:46 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:46.530063 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:46.539623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:46.541180 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:46.542354 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-02bcff0f-a2b9-4718-b656-cb910a7975b8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.188149 Mar 08 19:17:46.543117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 292/595] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:46 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:47.421487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-78507bd5-4181-426b-a1af-f935b1f39911 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:47.422087 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-78507bd5-4181-426b-a1af-f935b1f39911 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:47.429984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-78507bd5-4181-426b-a1af-f935b1f39911 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:47.430442 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-78507bd5-4181-426b-a1af-f935b1f39911 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:47.431235 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-78507bd5-4181-426b-a1af-f935b1f39911 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:47.431680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-78507bd5-4181-426b-a1af-f935b1f39911 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:47.567513 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:47.569175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:47.589994 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:47.590765 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:47.592017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:47.592744 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:47.600095 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-78507bd5-4181-426b-a1af-f935b1f39911 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:47.608293 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-78507bd5-4181-426b-a1af-f935b1f39911 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.190581 Mar 08 19:17:47.609429 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 304/596] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:47 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:47.809524 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:47.820612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:47.822150 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:47.823350 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ec006d39-1f20-46f0-8072-0b1162d261c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.265844 Mar 08 19:17:47.823905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 293/597] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:47 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:48.629902 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-80f17a5d-bf6c-4416-856b-1d041aca5c59 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:48.630662 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-80f17a5d-bf6c-4416-856b-1d041aca5c59 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:48.637948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-80f17a5d-bf6c-4416-856b-1d041aca5c59 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:48.638398 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-80f17a5d-bf6c-4416-856b-1d041aca5c59 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:48.639183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-80f17a5d-bf6c-4416-856b-1d041aca5c59 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:48.639723 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-80f17a5d-bf6c-4416-856b-1d041aca5c59 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:48.793277 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-80f17a5d-bf6c-4416-856b-1d041aca5c59 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:48.805963 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-80f17a5d-bf6c-4416-856b-1d041aca5c59 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.182677 Mar 08 19:17:48.811603 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 305/598] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:48 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:48.844624 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:48.846525 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:48.852984 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:48.853698 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:48.854658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:48.855470 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:49.040844 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:49.052259 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:49.054791 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:49.056173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2844f2d6-b5aa-4730-8ebd-b0e409c0df60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.216156 Mar 08 19:17:49.057201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 294/599] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:48 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:49.824231 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-300506a1-18f1-498b-8b58-b2ffc9f1f7ce tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:49.831010 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-300506a1-18f1-498b-8b58-b2ffc9f1f7ce tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:49.834128 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-300506a1-18f1-498b-8b58-b2ffc9f1f7ce tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:49.834128 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-300506a1-18f1-498b-8b58-b2ffc9f1f7ce tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:49.834128 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-300506a1-18f1-498b-8b58-b2ffc9f1f7ce tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:49.834457 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-300506a1-18f1-498b-8b58-b2ffc9f1f7ce tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:50.009740 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-300506a1-18f1-498b-8b58-b2ffc9f1f7ce tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:50.023693 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-300506a1-18f1-498b-8b58-b2ffc9f1f7ce tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.203151 Mar 08 19:17:50.025479 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 306/600] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:49 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:50.076205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:50.077237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:50.090091 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:50.090977 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:50.092408 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:50.093408 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:50.273392 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:50.282250 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:50.283950 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:50.285372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3c99c444-fab3-4b92-85b4-031725d7568f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.214444 Mar 08 19:17:50.286012 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 295/601] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:50 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:51.042698 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-618973f6-6b33-4493-bd71-da14a7baa3ef tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:51.043437 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-618973f6-6b33-4493-bd71-da14a7baa3ef tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:51.051051 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-618973f6-6b33-4493-bd71-da14a7baa3ef tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:51.051508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-618973f6-6b33-4493-bd71-da14a7baa3ef tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:51.052545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-618973f6-6b33-4493-bd71-da14a7baa3ef tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:51.052983 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-618973f6-6b33-4493-bd71-da14a7baa3ef tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:51.194952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-618973f6-6b33-4493-bd71-da14a7baa3ef tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:51.203441 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-618973f6-6b33-4493-bd71-da14a7baa3ef tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.164884 Mar 08 19:17:51.205720 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 307/602] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:51 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:51.312311 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:51.313084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:51.319947 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:51.320393 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:51.321166 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:51.321603 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:51.481564 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:51.490586 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:51.492233 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:51.493403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c0d56981-1cad-45d2-99ce-d9c867d2390f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.185575 Mar 08 19:17:51.493946 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 296/603] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:51 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:52.229666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-42d95e83-5fcb-469d-ad29-333621d35a9c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:52.230306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-42d95e83-5fcb-469d-ad29-333621d35a9c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:52.237945 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-42d95e83-5fcb-469d-ad29-333621d35a9c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:52.238515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-42d95e83-5fcb-469d-ad29-333621d35a9c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:52.239531 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-42d95e83-5fcb-469d-ad29-333621d35a9c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:52.240140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-42d95e83-5fcb-469d-ad29-333621d35a9c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:52.398303 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-42d95e83-5fcb-469d-ad29-333621d35a9c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:52.404135 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-42d95e83-5fcb-469d-ad29-333621d35a9c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.178359 Mar 08 19:17:52.404893 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 308/604] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:52 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:52.513389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:52.515109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:52.523606 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:52.524652 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:52.525741 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:52.526393 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:52.672930 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:52.682586 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:52.684550 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:52.685731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-65332b4b-4a65-4008-9209-97e4dc017cea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.177043 Mar 08 19:17:52.686508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 297/605] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:52 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:53.421908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9910418d-1702-46c7-810c-9e3828e6b53f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:53.422547 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9910418d-1702-46c7-810c-9e3828e6b53f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:53.429225 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9910418d-1702-46c7-810c-9e3828e6b53f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:53.429680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9910418d-1702-46c7-810c-9e3828e6b53f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:53.430448 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9910418d-1702-46c7-810c-9e3828e6b53f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:53.430888 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9910418d-1702-46c7-810c-9e3828e6b53f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:53.565869 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9910418d-1702-46c7-810c-9e3828e6b53f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:53.573575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9910418d-1702-46c7-810c-9e3828e6b53f tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.155758 Mar 08 19:17:53.574160 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 309/606] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:53 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:53.705145 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:53.705793 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:53.712151 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:53.712602 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:53.713365 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:53.713800 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:53.851072 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:53.859271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:53.861021 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:53.862301 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b262dd81-fec1-4f35-a19b-49473f8700ea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.161156 Mar 08 19:17:53.862853 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 298/607] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:53 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:54.591517 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-75e1a9b2-c84e-4f0e-a7f7-4b260fb2233c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:54.592152 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-75e1a9b2-c84e-4f0e-a7f7-4b260fb2233c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:54.600524 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-75e1a9b2-c84e-4f0e-a7f7-4b260fb2233c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:54.601179 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-75e1a9b2-c84e-4f0e-a7f7-4b260fb2233c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:54.602035 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-75e1a9b2-c84e-4f0e-a7f7-4b260fb2233c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:54.602469 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-75e1a9b2-c84e-4f0e-a7f7-4b260fb2233c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:54.753037 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-75e1a9b2-c84e-4f0e-a7f7-4b260fb2233c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:54.760545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-75e1a9b2-c84e-4f0e-a7f7-4b260fb2233c tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.173499 Mar 08 19:17:54.761104 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 310/608] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:54 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:17:54.880491 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:54.881106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:54.887657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:54.888178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:54.888936 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:54.889371 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:55.040836 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:55.052608 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:55.054121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:55.055286 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8167f674-4924-4631-800e-0221e708ff57 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.178774 Mar 08 19:17:55.055844 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 299/609] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:54 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:17:55.777047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fec3d53d-af8a-40cc-96e2-72e29230582b tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:55.777699 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fec3d53d-af8a-40cc-96e2-72e29230582b tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:55.785780 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fec3d53d-af8a-40cc-96e2-72e29230582b tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:55.786182 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fec3d53d-af8a-40cc-96e2-72e29230582b tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:55.786963 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fec3d53d-af8a-40cc-96e2-72e29230582b tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:55.787407 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fec3d53d-af8a-40cc-96e2-72e29230582b tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:55.924951 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fec3d53d-af8a-40cc-96e2-72e29230582b tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:55.932464 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fec3d53d-af8a-40cc-96e2-72e29230582b tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.159324 Mar 08 19:17:55.933031 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 311/610] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:55 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:56.077499 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:56.078639 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:56.086079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:56.086522 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:56.087291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:56.087742 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:56.227840 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:56.237382 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:56.238905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:56.240124 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d2c52d5a-8559-4cc8-91ce-d1e12209b082 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.166403 Mar 08 19:17:56.250149 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 300/611] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:56 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:56.949870 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-019180bf-cae5-4b55-a8e6-d057271ba6d3 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:56.950574 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-019180bf-cae5-4b55-a8e6-d057271ba6d3 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:56.956947 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-019180bf-cae5-4b55-a8e6-d057271ba6d3 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:56.957394 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-019180bf-cae5-4b55-a8e6-d057271ba6d3 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:56.958157 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-019180bf-cae5-4b55-a8e6-d057271ba6d3 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:56.958593 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-019180bf-cae5-4b55-a8e6-d057271ba6d3 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:57.088275 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-019180bf-cae5-4b55-a8e6-d057271ba6d3 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:57.096358 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-019180bf-cae5-4b55-a8e6-d057271ba6d3 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.150314 Mar 08 19:17:57.096949 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 312/612] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:56 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:57.265963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:57.265963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:57.265963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:57.266603 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:57.266979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:57.267612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:57.414403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:57.419536 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:57.421088 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:57.422230 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f8f15fa5-33c3-4c7a-829e-b1170953b85a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.167573 Mar 08 19:17:57.422809 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 301/613] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:57 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:58.113489 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ed06e080-35cf-4510-a8ae-65f3d963fd5d tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:58.114257 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ed06e080-35cf-4510-a8ae-65f3d963fd5d tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:58.120695 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ed06e080-35cf-4510-a8ae-65f3d963fd5d tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:58.121153 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ed06e080-35cf-4510-a8ae-65f3d963fd5d tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:58.121925 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ed06e080-35cf-4510-a8ae-65f3d963fd5d tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:58.122369 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ed06e080-35cf-4510-a8ae-65f3d963fd5d tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:58.264088 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ed06e080-35cf-4510-a8ae-65f3d963fd5d tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:58.277324 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ed06e080-35cf-4510-a8ae-65f3d963fd5d tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1317 microversion: 2.1 time: 0.167619 Mar 08 19:17:58.277901 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 313/614] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:58 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:58.443026 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:58.443641 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:58.450052 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:58.450500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:58.454065 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:58.454576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:58.621369 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:58.636244 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:58.639277 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:58.646607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9dd08d27-56f5-4871-a7ef-aa430e3c7ea1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.208369 Mar 08 19:17:58.647317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 302/615] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:58 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:17:59.297816 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-943b9b1d-3947-47b3-8560-03bd4ef103d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:59.299478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-943b9b1d-3947-47b3-8560-03bd4ef103d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:59.308870 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-943b9b1d-3947-47b3-8560-03bd4ef103d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:59.309633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-943b9b1d-3947-47b3-8560-03bd4ef103d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:59.310951 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-943b9b1d-3947-47b3-8560-03bd4ef103d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:59.311392 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-943b9b1d-3947-47b3-8560-03bd4ef103d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:59.460859 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-943b9b1d-3947-47b3-8560-03bd4ef103d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:59.468105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-943b9b1d-3947-47b3-8560-03bd4ef103d0 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1507 microversion: 2.1 time: 0.176572 Mar 08 19:17:59.468693 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 314/616] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:17:59 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1507 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:17:59.484812 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5fc0addd-4d00-4d1b-933e-93f03b52fd45 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48776e06-e63f-4478-a370-671c68670a2c", "device": "/dev/sdb"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:17:59.487053 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5fc0addd-4d00-4d1b-933e-93f03b52fd45 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:59.493621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fc0addd-4d00-4d1b-933e-93f03b52fd45 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:59.494107 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fc0addd-4d00-4d1b-933e-93f03b52fd45 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:59.494886 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fc0addd-4d00-4d1b-933e-93f03b52fd45 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:59.495318 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fc0addd-4d00-4d1b-933e-93f03b52fd45 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:59.665338 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:17:59.666679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:17:59.674761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:59.675258 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:59.676076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:17:59.676753 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:17:59.816851 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:59.825296 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:59.827002 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:17:59.830722 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2d5304ca-90a1-4686-a829-91d26830d7b6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.167145 Mar 08 19:17:59.830722 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 315/617] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:17:59 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:18:00.280979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5fc0addd-4d00-4d1b-933e-93f03b52fd45 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "POST /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.799836 Mar 08 19:18:00.281507 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 303/618] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:17:59 2022] POST /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5/os-volume_attachments => generated 194 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:18:00.848062 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:00.849112 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:00.858663 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:00.859328 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:00.860179 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:00.860666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:01.013775 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:01.023130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:01.024679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:01.025849 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-55637479-5456-4717-b06c-0d3c1bd8a697 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.183002 Mar 08 19:18:01.026396 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 316/619] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:00 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:18:02.045136 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:02.045837 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:02.052454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:02.052959 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:02.053735 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:02.054170 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:02.196846 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:02.207781 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:02.209559 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:02.210743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-63e9c1ee-f057-46d6-b48d-6300958ea3c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.170254 Mar 08 19:18:02.211296 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 304/620] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:02 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:03.232834 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:03.233639 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:03.240163 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:03.240610 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:03.241444 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:03.241989 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:03.389401 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:03.398393 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:03.399941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:03.401082 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-212d0224-cdfa-4a19-b3ad-c5d303779c7c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.172251 Mar 08 19:18:03.401676 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 317/621] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:03 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:04.421503 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:04.422104 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:04.428734 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:04.429180 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:04.429935 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:04.430362 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:04.570500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:04.579076 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:04.581208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:04.582374 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8396e2fb-ffae-4b40-b738-3820616647dd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.164854 Mar 08 19:18:04.582916 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 305/622] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:04 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:05.602209 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:05.602813 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:05.609539 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:05.609928 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:05.611317 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:05.611873 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:05.743445 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:05.751976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:05.753505 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:05.754715 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4c7843f0-2b97-4f20-9710-83fedb6b5478 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.156415 Mar 08 19:18:05.755273 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 318/623] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:05 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:06.773359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:06.773916 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:06.780178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:06.780637 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:06.781389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:06.781830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:06.918565 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:06.928136 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:06.929331 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:06.930485 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-38286c92-b470-4132-882e-86b2cc083768 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.161099 Mar 08 19:18:06.931115 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 306/624] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:06 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:18:07.376266 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-d773dd5a-6b68-499e-9962-955d2c538277 req-35bf7421-797e-4a12-b224-cdf1aa23b5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d4ea86-f489-4d6d-995e-1999c95b744d", "name": "network-vif-plugged", "status": "completed", "tag": "73344e8e-b327-42b5-a317-814f95b92074"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:18:07.386130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-d773dd5a-6b68-499e-9962-955d2c538277 req-35bf7421-797e-4a12-b224-cdf1aa23b5f4 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:07.386574 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-d773dd5a-6b68-499e-9962-955d2c538277 req-35bf7421-797e-4a12-b224-cdf1aa23b5f4 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:07.398167 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-d773dd5a-6b68-499e-9962-955d2c538277 req-35bf7421-797e-4a12-b224-cdf1aa23b5f4 service nova] Creating event network-vif-plugged:73344e8e-b327-42b5-a317-814f95b92074 for instance c1d4ea86-f489-4d6d-995e-1999c95b744d on hv-cinder-83009 Mar 08 19:18:07.403454 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-d773dd5a-6b68-499e-9962-955d2c538277 req-35bf7421-797e-4a12-b224-cdf1aa23b5f4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031589 Mar 08 19:18:07.404071 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 319/625] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:18:07.948675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:07.949927 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:07.956303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:07.956748 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:07.957681 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:07.958122 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:08.118540 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:08.126761 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:08.128306 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:08.130157 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d245831d-94da-46ad-b30b-9c1347a7fcd0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.185554 Mar 08 19:18:08.130722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 307/626] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:07 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:18:09.155080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:09.157700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:09.162328 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:09.162778 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:09.163541 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:09.164001 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:09.299038 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:09.307671 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:09.309315 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:09.310393 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0b3304c1-1152-4bc6-b9c8-51f3e0859110 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.160062 Mar 08 19:18:09.310948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 320/627] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:09 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:10.329282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:10.329890 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:10.336472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:10.340862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:10.340862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:10.340862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:10.482040 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:10.497051 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:10.498593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:10.500002 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ee4f0597-9757-4afe-9576-dd2854a33aaa tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.174387 Mar 08 19:18:10.500758 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 308/628] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:10 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:11.525491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:11.526063 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:11.532455 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:11.532920 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:11.533680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:11.534110 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:11.669598 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:11.679400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:11.681062 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:11.682263 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d67b2735-2f1a-47d0-a63d-f45a8743c0d0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.161113 Mar 08 19:18:11.683574 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 321/629] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:11 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:18:12.701604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:12.702205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:12.709594 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:12.710038 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:12.710795 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:12.711228 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:12.870463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:12.879319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:12.880852 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:12.881993 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-05bfc1db-0fda-4420-b3c5-46183ddba90a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.184299 Mar 08 19:18:12.882535 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 309/630] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:12 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:13.901015 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:13.901619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:13.908059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:13.908537 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:13.909300 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:13.909761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:14.047371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:14.056313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:14.057829 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:14.058982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ba78f0ae-2c66-4c2d-983e-9a5a39fadbb3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.162060 Mar 08 19:18:14.059537 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 322/631] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:13 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:15.078238 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:15.078853 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:15.086664 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:15.087206 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:15.088085 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:15.088527 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:15.230810 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:15.239297 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:15.240927 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:15.242613 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-15b8df07-720e-49bc-8fee-bae92be701db tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1809 microversion: 2.20 time: 0.168714 Mar 08 19:18:15.243171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 310/632] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:15 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:16.263058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:16.263667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:16.270095 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:16.270735 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:16.271853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:16.272337 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:16.409864 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:16.419409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:16.420939 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:16.422090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8f6a1ebd-f07c-4f3d-ad34-55846222ff15 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1796 microversion: 2.20 time: 0.163351 Mar 08 19:18:16.422640 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 323/633] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:18:16 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1796 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:18:24.539940 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-43e41bea-8200-479d-8a9d-4ce5502902bb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:24.540489 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-43e41bea-8200-479d-8a9d-4ce5502902bb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:24.546841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43e41bea-8200-479d-8a9d-4ce5502902bb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:24.547286 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43e41bea-8200-479d-8a9d-4ce5502902bb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:24.548076 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43e41bea-8200-479d-8a9d-4ce5502902bb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:24.548508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43e41bea-8200-479d-8a9d-4ce5502902bb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:24.781963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-43e41bea-8200-479d-8a9d-4ce5502902bb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lazy-loading 'services' on Instance uuid 8c05a596-08f8-4d79-b15c-01475fa474d5 {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:18:24.990119 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-43e41bea-8200-479d-8a9d-4ce5502902bb tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5/os-volume_attachments/48776e06-e63f-4478-a370-671c68670a2c" status: 202 len: 0 microversion: 2.1 time: 0.454942 Mar 08 19:18:24.990706 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 311/634] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:18:24 2022] DELETE /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5/os-volume_attachments/48776e06-e63f-4478-a370-671c68670a2c => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:18:26.109467 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-59b86bce-adbd-4e88-af3b-621bc4911b11 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:26.110350 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-59b86bce-adbd-4e88-af3b-621bc4911b11 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:26.117546 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59b86bce-adbd-4e88-af3b-621bc4911b11 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:26.119876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59b86bce-adbd-4e88-af3b-621bc4911b11 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:26.119876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59b86bce-adbd-4e88-af3b-621bc4911b11 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:26.119876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59b86bce-adbd-4e88-af3b-621bc4911b11 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:26.143939 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-59b86bce-adbd-4e88-af3b-621bc4911b11 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:18:26.436982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-59b86bce-adbd-4e88-af3b-621bc4911b11 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 204 len: 0 microversion: 2.1 time: 0.331106 Mar 08 19:18:26.437597 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 324/635] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:18:26 2022] DELETE /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:18:26.449787 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8c14f23a-f5ff-4624-a96b-ccccabc48d88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:26.450484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8c14f23a-f5ff-4624-a96b-ccccabc48d88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:26.456643 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8c14f23a-f5ff-4624-a96b-ccccabc48d88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:26.457093 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8c14f23a-f5ff-4624-a96b-ccccabc48d88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:26.457855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8c14f23a-f5ff-4624-a96b-ccccabc48d88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:26.458291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8c14f23a-f5ff-4624-a96b-ccccabc48d88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:26.607229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8c14f23a-f5ff-4624-a96b-ccccabc48d88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:26.615016 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8c14f23a-f5ff-4624-a96b-ccccabc48d88 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1513 microversion: 2.1 time: 0.170535 Mar 08 19:18:26.615579 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 312/636] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:18:26 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:18:27.633371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-496ceb3a-adbf-4c5e-a568-e61a09f61016 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:27.634075 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-496ceb3a-adbf-4c5e-a568-e61a09f61016 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:27.640812 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-496ceb3a-adbf-4c5e-a568-e61a09f61016 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:27.641256 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-496ceb3a-adbf-4c5e-a568-e61a09f61016 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:27.642018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-496ceb3a-adbf-4c5e-a568-e61a09f61016 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:27.642450 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-496ceb3a-adbf-4c5e-a568-e61a09f61016 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:27.879273 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-496ceb3a-adbf-4c5e-a568-e61a09f61016 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:27.888229 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-496ceb3a-adbf-4c5e-a568-e61a09f61016 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1513 microversion: 2.1 time: 0.259601 Mar 08 19:18:27.888700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 325/637] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:18:27 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:18:28.906082 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7bdfa190-4252-4b21-b74f-f521efc17af9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:28.906791 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7bdfa190-4252-4b21-b74f-f521efc17af9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:28.913617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7bdfa190-4252-4b21-b74f-f521efc17af9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:28.915700 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7bdfa190-4252-4b21-b74f-f521efc17af9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:28.916709 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7bdfa190-4252-4b21-b74f-f521efc17af9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:28.918523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7bdfa190-4252-4b21-b74f-f521efc17af9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:29.135882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7bdfa190-4252-4b21-b74f-f521efc17af9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:29.143841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7bdfa190-4252-4b21-b74f-f521efc17af9 tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1513 microversion: 2.1 time: 0.241734 Mar 08 19:18:29.144475 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 313/638] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:18:28 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1513 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:18:29.578975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-da5ad89e-07c6-4960-917f-5dfe3e70581f req-abb78677-288e-4ffa-a91f-ae604c9e62ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c05a596-08f8-4d79-b15c-01475fa474d5", "name": "network-vif-deleted", "tag": "604c84cd-7106-455e-a449-d54438924a60"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:18:29.587310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-da5ad89e-07c6-4960-917f-5dfe3e70581f req-abb78677-288e-4ffa-a91f-ae604c9e62ff service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:29.589341 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-da5ad89e-07c6-4960-917f-5dfe3e70581f req-abb78677-288e-4ffa-a91f-ae604c9e62ff service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:29.602992 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-da5ad89e-07c6-4960-917f-5dfe3e70581f req-abb78677-288e-4ffa-a91f-ae604c9e62ff service nova] Creating event network-vif-deleted:604c84cd-7106-455e-a449-d54438924a60 for instance 8c05a596-08f8-4d79-b15c-01475fa474d5 on hv-cinder-83009 Mar 08 19:18:29.608140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-da5ad89e-07c6-4960-917f-5dfe3e70581f req-abb78677-288e-4ffa-a91f-ae604c9e62ff service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032756 Mar 08 19:18:29.608744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 326/639] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:18:30.161502 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:30.162113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:30.169177 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:30.169637 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:30.170405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:30.170835 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:30.202000 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:30.202369 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:30.202814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lazy-loading 'fault' on Instance uuid 8c05a596-08f8-4d79-b15c-01475fa474d5 {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:18:30.247062 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b56bbaadcca041fe89e65bfb79526a8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f10261552daf4cb9a0cf1b53cb019b42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:18:30.256237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-307362c8-860f-4809-b28a-9a5afffe97ee tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 200 len: 1307 microversion: 2.1 time: 0.098549 Mar 08 19:18:30.256819 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 314/640] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:18:30 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:18:31.276909 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:18:31.277550 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] [instance: 8c05a596-08f8-4d79-b15c-01475fa474d5] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:18:31.283893 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:31.284374 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:31.285147 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:18:31.285583 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:18:31.301116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] HTTP exception thrown: Instance 8c05a596-08f8-4d79-b15c-01475fa474d5 could not be found. Mar 08 19:18:31.301921 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] Returning 404 to user: Instance 8c05a596-08f8-4d79-b15c-01475fa474d5 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:18:31.303387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ce4012b0-a4e8-4886-b014-eecfce377a7e tempest-VolumesSnapshotTestJSON-481175762 tempest-VolumesSnapshotTestJSON-481175762-project] 10.222.0.75 "GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5" status: 404 len: 111 microversion: 2.1 time: 0.031545 Mar 08 19:18:31.304335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 327/641] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:18:31 2022] GET /compute/v2.1/servers/8c05a596-08f8-4d79-b15c-01475fa474d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:19:09.315627 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-680270797", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:09.368685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] validate_networks() for None {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:19:09.669469 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:19:09.670457 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:19:09.670457 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:19:09.671015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:19:09.671434 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:19:09.681290 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:09.681848 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:09.682685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:09.683196 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:09.703372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Getting quotas for project 6509c639b99349028c1d770b063a40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:09.709537 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Getting quotas for user 557ca34931b14e7fb8c07248867bb4dd and project 6509c639b99349028c1d770b063a40c7. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:09.722385 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:19:09.724931 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:19:09.815117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-da4901df-14f2-46da-8cb1-054ca5fd804e tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503271 Mar 08 19:19:09.815820 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 315/642] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:19:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:19:09.827704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c2846e8f-3485-41d6-be77-8bd7943a88b8 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:09.831711 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c2846e8f-3485-41d6-be77-8bd7943a88b8 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:09.982863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c2846e8f-3485-41d6-be77-8bd7943a88b8 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:09.990906 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c2846e8f-3485-41d6-be77-8bd7943a88b8 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1214 microversion: 2.1 time: 0.167573 Mar 08 19:19:09.991487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 328/643] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:09 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:11.013800 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9c08d4e9-f29f-4abd-8175-247359397453 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:11.014960 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9c08d4e9-f29f-4abd-8175-247359397453 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:11.079491 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9c08d4e9-f29f-4abd-8175-247359397453 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:11.089076 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9c08d4e9-f29f-4abd-8175-247359397453 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1214 microversion: 2.1 time: 0.082529 Mar 08 19:19:11.099109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 316/644] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:11 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:12.108236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e6000b85-e197-486a-b3bb-890997954f15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:12.109112 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e6000b85-e197-486a-b3bb-890997954f15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:12.117304 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e6000b85-e197-486a-b3bb-890997954f15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:12.117752 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e6000b85-e197-486a-b3bb-890997954f15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:12.118535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e6000b85-e197-486a-b3bb-890997954f15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:12.119328 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e6000b85-e197-486a-b3bb-890997954f15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:12.200189 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e6000b85-e197-486a-b3bb-890997954f15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:12.208100 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e6000b85-e197-486a-b3bb-890997954f15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1266 microversion: 2.1 time: 0.104550 Mar 08 19:19:12.208674 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 329/645] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:12 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:13.228570 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b24f2e28-b45a-4a4b-a142-d83cbf7cd703 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:13.230007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b24f2e28-b45a-4a4b-a142-d83cbf7cd703 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:13.237782 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b24f2e28-b45a-4a4b-a142-d83cbf7cd703 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:13.238681 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b24f2e28-b45a-4a4b-a142-d83cbf7cd703 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:13.239966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b24f2e28-b45a-4a4b-a142-d83cbf7cd703 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:13.240737 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b24f2e28-b45a-4a4b-a142-d83cbf7cd703 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:13.472501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b24f2e28-b45a-4a4b-a142-d83cbf7cd703 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:13.493923 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b24f2e28-b45a-4a4b-a142-d83cbf7cd703 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1314 microversion: 2.1 time: 0.267990 Mar 08 19:19:13.493923 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 317/646] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:13 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:14.510460 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-86023c9e-4478-4f37-9f2a-6cdcb2916d04 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:14.511173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-86023c9e-4478-4f37-9f2a-6cdcb2916d04 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:14.519248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-86023c9e-4478-4f37-9f2a-6cdcb2916d04 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:14.520301 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-86023c9e-4478-4f37-9f2a-6cdcb2916d04 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:14.521517 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-86023c9e-4478-4f37-9f2a-6cdcb2916d04 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:14.522106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-86023c9e-4478-4f37-9f2a-6cdcb2916d04 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:14.651496 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-f9e5ed1a-9e34-47fa-85c5-bef25136bba9 req-366e392b-745b-4f39-a691-b54d5c68fbf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bca87c35-ae00-410a-aaf8-986bc90f7b7b", "tag": "88e3d9d2-4035-4f05-b9cb-96be766929cf"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:14.661699 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-f9e5ed1a-9e34-47fa-85c5-bef25136bba9 req-366e392b-745b-4f39-a691-b54d5c68fbf1 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:14.662140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-f9e5ed1a-9e34-47fa-85c5-bef25136bba9 req-366e392b-745b-4f39-a691-b54d5c68fbf1 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:14.679714 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-f9e5ed1a-9e34-47fa-85c5-bef25136bba9 req-366e392b-745b-4f39-a691-b54d5c68fbf1 service nova] Creating event network-changed:88e3d9d2-4035-4f05-b9cb-96be766929cf for instance bca87c35-ae00-410a-aaf8-986bc90f7b7b on hv-cinder-83009 Mar 08 19:19:14.686095 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-f9e5ed1a-9e34-47fa-85c5-bef25136bba9 req-366e392b-745b-4f39-a691-b54d5c68fbf1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.270643 Mar 08 19:19:14.687126 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 330/647] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:14.829714 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-86023c9e-4478-4f37-9f2a-6cdcb2916d04 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:14.840499 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-86023c9e-4478-4f37-9f2a-6cdcb2916d04 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1314 microversion: 2.1 time: 0.334631 Mar 08 19:19:14.841339 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 318/648] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:14 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:15.860356 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-547f0287-1287-4323-8d67-00766ce6c3a2 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:15.861971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-547f0287-1287-4323-8d67-00766ce6c3a2 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:15.868983 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-547f0287-1287-4323-8d67-00766ce6c3a2 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:15.869652 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-547f0287-1287-4323-8d67-00766ce6c3a2 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:15.870604 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-547f0287-1287-4323-8d67-00766ce6c3a2 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:15.871262 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-547f0287-1287-4323-8d67-00766ce6c3a2 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:16.025470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-547f0287-1287-4323-8d67-00766ce6c3a2 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:16.032939 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-547f0287-1287-4323-8d67-00766ce6c3a2 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1314 microversion: 2.1 time: 0.177675 Mar 08 19:19:16.033544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 331/649] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:15 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:16.124565 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-323884a6-004e-44ab-9ad7-79a17faf937a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:16.125076 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-323884a6-004e-44ab-9ad7-79a17faf937a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:16.131501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-323884a6-004e-44ab-9ad7-79a17faf937a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:16.131965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-323884a6-004e-44ab-9ad7-79a17faf937a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:16.132909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-323884a6-004e-44ab-9ad7-79a17faf937a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:16.133346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-323884a6-004e-44ab-9ad7-79a17faf937a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:16.211824 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-323884a6-004e-44ab-9ad7-79a17faf937a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lazy-loading 'services' on Instance uuid e431bba0-7d48-4fff-ace4-d5ba4a32a2ea {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:19:16.452966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-323884a6-004e-44ab-9ad7-79a17faf937a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/os-volume_attachments/56225522-ec0b-4a7f-89c3-cfca9e6aed32" status: 202 len: 0 microversion: 2.1 time: 0.461283 Mar 08 19:19:16.453557 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 319/650] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:19:15 2022] DELETE /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/os-volume_attachments/56225522-ec0b-4a7f-89c3-cfca9e6aed32 => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:19:17.049687 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7187794a-8028-4269-b737-c180f7c5cb15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:17.051268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7187794a-8028-4269-b737-c180f7c5cb15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:17.058487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7187794a-8028-4269-b737-c180f7c5cb15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:17.059018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7187794a-8028-4269-b737-c180f7c5cb15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:17.059871 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7187794a-8028-4269-b737-c180f7c5cb15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:17.060426 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7187794a-8028-4269-b737-c180f7c5cb15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:17.287419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7187794a-8028-4269-b737-c180f7c5cb15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:17.301619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7187794a-8028-4269-b737-c180f7c5cb15 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1314 microversion: 2.1 time: 0.255860 Mar 08 19:19:17.315323 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 332/651] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:17 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:18.324178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-daf98836-a53f-41a0-8b87-d795ae977bea tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:18.327154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-daf98836-a53f-41a0-8b87-d795ae977bea tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:18.336605 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-daf98836-a53f-41a0-8b87-d795ae977bea tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:18.337474 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-daf98836-a53f-41a0-8b87-d795ae977bea tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:18.339533 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-daf98836-a53f-41a0-8b87-d795ae977bea tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:18.342964 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-daf98836-a53f-41a0-8b87-d795ae977bea tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:18.516531 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-daf98836-a53f-41a0-8b87-d795ae977bea tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:18.524501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-daf98836-a53f-41a0-8b87-d795ae977bea tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1314 microversion: 2.1 time: 0.208033 Mar 08 19:19:18.525079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 320/652] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:18 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:19.543087 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c0762adc-0636-4065-be37-cbd053934f33 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:19.544341 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c0762adc-0636-4065-be37-cbd053934f33 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:19.554915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c0762adc-0636-4065-be37-cbd053934f33 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:19.554915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c0762adc-0636-4065-be37-cbd053934f33 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:19.554915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c0762adc-0636-4065-be37-cbd053934f33 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:19.554915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c0762adc-0636-4065-be37-cbd053934f33 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:19.846391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c0762adc-0636-4065-be37-cbd053934f33 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:19.859344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c0762adc-0636-4065-be37-cbd053934f33 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1314 microversion: 2.1 time: 0.320416 Mar 08 19:19:19.871171 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 333/653] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:19 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1314 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:20.398136 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-47e4b4f8-fa08-4108-b45b-f1f19c6a02d8 req-f4f8bd85-a4f0-4423-a7b4-fa20c5f2953d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca87c35-ae00-410a-aaf8-986bc90f7b7b", "name": "network-vif-plugged", "status": "completed", "tag": "88e3d9d2-4035-4f05-b9cb-96be766929cf"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:20.406758 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-47e4b4f8-fa08-4108-b45b-f1f19c6a02d8 req-f4f8bd85-a4f0-4423-a7b4-fa20c5f2953d service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:20.407265 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-47e4b4f8-fa08-4108-b45b-f1f19c6a02d8 req-f4f8bd85-a4f0-4423-a7b4-fa20c5f2953d service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:20.420474 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-47e4b4f8-fa08-4108-b45b-f1f19c6a02d8 req-f4f8bd85-a4f0-4423-a7b4-fa20c5f2953d service nova] Creating event network-vif-plugged:88e3d9d2-4035-4f05-b9cb-96be766929cf for instance bca87c35-ae00-410a-aaf8-986bc90f7b7b on hv-cinder-83009 Mar 08 19:19:20.427676 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-47e4b4f8-fa08-4108-b45b-f1f19c6a02d8 req-f4f8bd85-a4f0-4423-a7b4-fa20c5f2953d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.347940 Mar 08 19:19:20.428850 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 321/654] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:20.878404 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-11907831-3ca3-4c4b-8f52-940333e7d82f tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:20.879622 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-11907831-3ca3-4c4b-8f52-940333e7d82f tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:20.890076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-11907831-3ca3-4c4b-8f52-940333e7d82f tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:20.890813 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-11907831-3ca3-4c4b-8f52-940333e7d82f tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:20.891780 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-11907831-3ca3-4c4b-8f52-940333e7d82f tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:20.893087 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-11907831-3ca3-4c4b-8f52-940333e7d82f tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:21.506936 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-11907831-3ca3-4c4b-8f52-940333e7d82f tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:21.515977 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-11907831-3ca3-4c4b-8f52-940333e7d82f tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1314 microversion: 2.1 time: 0.642979 Mar 08 19:19:21.526601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 334/655] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:20 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1314 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:22.541820 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-07872771-bf7e-4916-b012-77d24db82359 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:22.542633 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-07872771-bf7e-4916-b012-77d24db82359 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:22.553679 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07872771-bf7e-4916-b012-77d24db82359 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:22.554382 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07872771-bf7e-4916-b012-77d24db82359 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:22.555459 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07872771-bf7e-4916-b012-77d24db82359 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:22.556837 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07872771-bf7e-4916-b012-77d24db82359 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:22.877696 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-07872771-bf7e-4916-b012-77d24db82359 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:22.893322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-07872771-bf7e-4916-b012-77d24db82359 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1463 microversion: 2.1 time: 0.361757 Mar 08 19:19:22.894687 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 322/656] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:22 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1463 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:22.972747 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7bbfe2d1-6486-4d3d-849a-01c8d5add8d4 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:22.973636 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7bbfe2d1-6486-4d3d-849a-01c8d5add8d4 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:22.984118 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7bbfe2d1-6486-4d3d-849a-01c8d5add8d4 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:22.984978 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7bbfe2d1-6486-4d3d-849a-01c8d5add8d4 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:22.986718 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7bbfe2d1-6486-4d3d-849a-01c8d5add8d4 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:22.987493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7bbfe2d1-6486-4d3d-849a-01c8d5add8d4 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:23.035203 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7bbfe2d1-6486-4d3d-849a-01c8d5add8d4 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:19:23.316305 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7bbfe2d1-6486-4d3d-849a-01c8d5add8d4 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "DELETE /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 204 len: 0 microversion: 2.1 time: 0.351976 Mar 08 19:19:23.316847 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 335/657] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:19:22 2022] DELETE /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:19:23.332933 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-dab1b848-b3dd-48f1-8afd-40bbcd874df9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:23.333715 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-dab1b848-b3dd-48f1-8afd-40bbcd874df9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:23.341094 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dab1b848-b3dd-48f1-8afd-40bbcd874df9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:23.341562 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dab1b848-b3dd-48f1-8afd-40bbcd874df9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:23.342367 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dab1b848-b3dd-48f1-8afd-40bbcd874df9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:23.343712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dab1b848-b3dd-48f1-8afd-40bbcd874df9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:23.598791 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-dab1b848-b3dd-48f1-8afd-40bbcd874df9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:23.617089 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-dab1b848-b3dd-48f1-8afd-40bbcd874df9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1469 microversion: 2.1 time: 0.295558 Mar 08 19:19:23.628286 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 323/658] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:23 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1469 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:24.635468 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-56eccf7c-c19b-4f03-9232-a1f5cce1d4e9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:24.639374 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-56eccf7c-c19b-4f03-9232-a1f5cce1d4e9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:24.647576 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-56eccf7c-c19b-4f03-9232-a1f5cce1d4e9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:24.648059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-56eccf7c-c19b-4f03-9232-a1f5cce1d4e9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:24.649188 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-56eccf7c-c19b-4f03-9232-a1f5cce1d4e9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:24.649709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-56eccf7c-c19b-4f03-9232-a1f5cce1d4e9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:24.817748 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-56eccf7c-c19b-4f03-9232-a1f5cce1d4e9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:24.826328 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-56eccf7c-c19b-4f03-9232-a1f5cce1d4e9 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1469 microversion: 2.1 time: 0.195306 Mar 08 19:19:24.827019 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 336/659] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:24 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:25.723171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-d0a1d145-7033-45b7-ad79-84e66bc9667a req-e37b9f96-dda7-4a02-8230-2954a4edc191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bca87c35-ae00-410a-aaf8-986bc90f7b7b", "name": "network-vif-deleted", "tag": "88e3d9d2-4035-4f05-b9cb-96be766929cf"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:25.740026 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-d0a1d145-7033-45b7-ad79-84e66bc9667a req-e37b9f96-dda7-4a02-8230-2954a4edc191 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:25.740751 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-d0a1d145-7033-45b7-ad79-84e66bc9667a req-e37b9f96-dda7-4a02-8230-2954a4edc191 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:25.756002 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-d0a1d145-7033-45b7-ad79-84e66bc9667a req-e37b9f96-dda7-4a02-8230-2954a4edc191 service nova] Creating event network-vif-deleted:88e3d9d2-4035-4f05-b9cb-96be766929cf for instance bca87c35-ae00-410a-aaf8-986bc90f7b7b on hv-cinder-83009 Mar 08 19:19:25.762941 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-d0a1d145-7033-45b7-ad79-84e66bc9667a req-e37b9f96-dda7-4a02-8230-2954a4edc191 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043364 Mar 08 19:19:25.764353 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 324/660] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:25.854918 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9c5f2a86-545f-491f-b5ca-21dabf4ce111 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:25.854918 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9c5f2a86-545f-491f-b5ca-21dabf4ce111 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:25.864302 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a86-545f-491f-b5ca-21dabf4ce111 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:25.865040 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a86-545f-491f-b5ca-21dabf4ce111 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:25.869042 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a86-545f-491f-b5ca-21dabf4ce111 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:25.869726 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9c5f2a86-545f-491f-b5ca-21dabf4ce111 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:25.999222 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9c5f2a86-545f-491f-b5ca-21dabf4ce111 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '557ca34931b14e7fb8c07248867bb4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6509c639b99349028c1d770b063a40c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:26.010365 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9c5f2a86-545f-491f-b5ca-21dabf4ce111 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 200 len: 1299 microversion: 2.1 time: 0.168035 Mar 08 19:19:26.013986 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 337/661] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:25 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 1299 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:27.034500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:27.035860 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] [instance: bca87c35-ae00-410a-aaf8-986bc90f7b7b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:27.042693 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:27.043142 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:27.044011 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:27.044372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:27.060742 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] HTTP exception thrown: Instance bca87c35-ae00-410a-aaf8-986bc90f7b7b could not be found. Mar 08 19:19:27.061571 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] Returning 404 to user: Instance bca87c35-ae00-410a-aaf8-986bc90f7b7b could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:19:27.062624 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-80e5d147-1905-4cb7-b269-7f8ab193f218 tempest-VolumesNegativeTest-1659018229 tempest-VolumesNegativeTest-1659018229-project] 10.222.0.75 "GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b" status: 404 len: 111 microversion: 2.1 time: 0.035748 Mar 08 19:19:27.063240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 325/662] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:27 2022] GET /compute/v2.1/servers/bca87c35-ae00-410a-aaf8-986bc90f7b7b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:19:28.373387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-759a3c46-2a77-42e1-913d-22a4a33a4e79 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:28.381490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-759a3c46-2a77-42e1-913d-22a4a33a4e79 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:28.382062 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-759a3c46-2a77-42e1-913d-22a4a33a4e79 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:28.406607 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-759a3c46-2a77-42e1-913d-22a4a33a4e79 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Going to try to stop instance {{(pid=117391) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 08 19:19:28.877965 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-759a3c46-2a77-42e1-913d-22a4a33a4e79 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/action" status: 202 len: 0 microversion: 2.1 time: 0.517198 Mar 08 19:19:28.883235 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 338/663] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:19:28 2022] POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:19:28.889679 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2e5bd6b1-c5e8-4fde-be76-4baac952d41b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:28.891166 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2e5bd6b1-c5e8-4fde-be76-4baac952d41b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:28.900154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e5bd6b1-c5e8-4fde-be76-4baac952d41b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:28.900975 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e5bd6b1-c5e8-4fde-be76-4baac952d41b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:28.901890 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e5bd6b1-c5e8-4fde-be76-4baac952d41b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:28.902374 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e5bd6b1-c5e8-4fde-be76-4baac952d41b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:29.049916 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2e5bd6b1-c5e8-4fde-be76-4baac952d41b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:29.057500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2e5bd6b1-c5e8-4fde-be76-4baac952d41b tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.172685 Mar 08 19:19:29.058054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 326/664] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:28 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:29.440849 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7d5593ab-9760-47a2-ba56-e27a97956d8e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:29.441973 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7d5593ab-9760-47a2-ba56-e27a97956d8e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:29.448479 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7d5593ab-9760-47a2-ba56-e27a97956d8e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:29.448938 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7d5593ab-9760-47a2-ba56-e27a97956d8e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:29.449713 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7d5593ab-9760-47a2-ba56-e27a97956d8e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:29.450342 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7d5593ab-9760-47a2-ba56-e27a97956d8e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:29.474248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7d5593ab-9760-47a2-ba56-e27a97956d8e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b/ips" status: 200 len: 150 microversion: 2.1 time: 0.198212 Mar 08 19:19:29.480639 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 339/665] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:19:29 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b/ips => generated 150 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:29.485665 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25b041f7-1519-4106-b55f-ac29e93a93ae"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:29.487254 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:29.493296 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:29.494162 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:29.495131 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:29.495721 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:29.589322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Invalid volume: volume 25b041f7-1519-4106-b55f-ac29e93a93ae is already attached to instances: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 Mar 08 19:19:29.590229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 400 to user: Invalid volume: volume 25b041f7-1519-4106-b55f-ac29e93a93ae is already attached to instances: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:19:29.591220 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f93d37de-8dc6-4781-8162-200201fa4c30 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109718 Mar 08 19:19:29.591757 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 327/666] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:19:29 2022] POST /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:19:29.602021 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-02491b60-0728-4d0a-aa04-137efda068c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:29.602530 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-02491b60-0728-4d0a-aa04-137efda068c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:29.608515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-02491b60-0728-4d0a-aa04-137efda068c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:29.609157 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-02491b60-0728-4d0a-aa04-137efda068c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:29.610093 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-02491b60-0728-4d0a-aa04-137efda068c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:29.610533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-02491b60-0728-4d0a-aa04-137efda068c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:29.638514 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-02491b60-0728-4d0a-aa04-137efda068c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:19:29.995803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-02491b60-0728-4d0a-aa04-137efda068c7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 204 len: 0 microversion: 2.1 time: 0.398619 Mar 08 19:19:29.996421 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 340/667] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:19:29 2022] DELETE /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:19:30.006725 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0f51601e-6281-43d0-a675-bb6d8ae760be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:30.007419 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0f51601e-6281-43d0-a675-bb6d8ae760be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:30.015251 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0f51601e-6281-43d0-a675-bb6d8ae760be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:30.015698 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0f51601e-6281-43d0-a675-bb6d8ae760be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:30.016690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0f51601e-6281-43d0-a675-bb6d8ae760be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:30.019291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0f51601e-6281-43d0-a675-bb6d8ae760be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:30.078178 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-759bcf07-8757-4d5c-aa70-4dca5f5edae2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:30.078925 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-759bcf07-8757-4d5c-aa70-4dca5f5edae2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:30.087624 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-759bcf07-8757-4d5c-aa70-4dca5f5edae2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:30.088114 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-759bcf07-8757-4d5c-aa70-4dca5f5edae2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:30.088897 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-759bcf07-8757-4d5c-aa70-4dca5f5edae2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:30.092436 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-759bcf07-8757-4d5c-aa70-4dca5f5edae2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:30.456035 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0f51601e-6281-43d0-a675-bb6d8ae760be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:30.467192 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0f51601e-6281-43d0-a675-bb6d8ae760be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1680 microversion: 2.1 time: 0.463616 Mar 08 19:19:30.478990 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 328/668] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:29 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1680 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:30.658744 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-759bcf07-8757-4d5c-aa70-4dca5f5edae2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:30.667194 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-759bcf07-8757-4d5c-aa70-4dca5f5edae2 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.593808 Mar 08 19:19:30.668724 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 341/669] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:30 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:31.488697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d2601143-e81e-482d-aa03-278fe82330d5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:31.489320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d2601143-e81e-482d-aa03-278fe82330d5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:31.499165 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2601143-e81e-482d-aa03-278fe82330d5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:31.499624 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2601143-e81e-482d-aa03-278fe82330d5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:31.500447 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2601143-e81e-482d-aa03-278fe82330d5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:31.500886 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2601143-e81e-482d-aa03-278fe82330d5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:31.688161 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0cf7e50e-9787-47e5-b793-a418011dc9bb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:31.688883 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0cf7e50e-9787-47e5-b793-a418011dc9bb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:31.696721 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0cf7e50e-9787-47e5-b793-a418011dc9bb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:31.697379 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0cf7e50e-9787-47e5-b793-a418011dc9bb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:31.698343 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0cf7e50e-9787-47e5-b793-a418011dc9bb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:31.698957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0cf7e50e-9787-47e5-b793-a418011dc9bb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:31.823831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d2601143-e81e-482d-aa03-278fe82330d5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:31.838686 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d2601143-e81e-482d-aa03-278fe82330d5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1680 microversion: 2.1 time: 0.350375 Mar 08 19:19:31.839670 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 329/670] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:31 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1680 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:32.059671 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0cf7e50e-9787-47e5-b793-a418011dc9bb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:32.071561 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0cf7e50e-9787-47e5-b793-a418011dc9bb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.387129 Mar 08 19:19:32.072535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 342/671] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:31 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:32.857558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-af3bdd9d-9957-4b17-8d46-681db02099f3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:32.858266 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-af3bdd9d-9957-4b17-8d46-681db02099f3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:32.866043 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-af3bdd9d-9957-4b17-8d46-681db02099f3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:32.866512 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-af3bdd9d-9957-4b17-8d46-681db02099f3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:32.867324 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-af3bdd9d-9957-4b17-8d46-681db02099f3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:32.867749 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-af3bdd9d-9957-4b17-8d46-681db02099f3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:33.049909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-af3bdd9d-9957-4b17-8d46-681db02099f3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:33.057170 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-af3bdd9d-9957-4b17-8d46-681db02099f3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1680 microversion: 2.1 time: 0.203737 Mar 08 19:19:33.057719 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 330/672] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:32 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1680 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:33.088732 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b789061e-de38-457e-96d0-49e6149b8dfa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:33.089353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b789061e-de38-457e-96d0-49e6149b8dfa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:33.096168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b789061e-de38-457e-96d0-49e6149b8dfa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:33.096591 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b789061e-de38-457e-96d0-49e6149b8dfa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:33.097363 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b789061e-de38-457e-96d0-49e6149b8dfa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:33.097801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b789061e-de38-457e-96d0-49e6149b8dfa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:33.239791 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b789061e-de38-457e-96d0-49e6149b8dfa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:33.249476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b789061e-de38-457e-96d0-49e6149b8dfa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.164301 Mar 08 19:19:33.250409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 343/673] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:33 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:33.680289 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-7cd0582b-6aea-4ad8-96ef-326ca658903f req-85a13a88-c7cf-4cc9-9c06-9877c42813c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8644e465-6137-4694-97d5-5348bc14e92b", "name": "network-vif-deleted", "tag": "d24e8526-b0cb-4096-8754-39963dbac7a3"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:33.692829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-7cd0582b-6aea-4ad8-96ef-326ca658903f req-85a13a88-c7cf-4cc9-9c06-9877c42813c1 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:33.694159 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-7cd0582b-6aea-4ad8-96ef-326ca658903f req-85a13a88-c7cf-4cc9-9c06-9877c42813c1 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:33.715831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-7cd0582b-6aea-4ad8-96ef-326ca658903f req-85a13a88-c7cf-4cc9-9c06-9877c42813c1 service nova] Creating event network-vif-deleted:d24e8526-b0cb-4096-8754-39963dbac7a3 for instance 8644e465-6137-4694-97d5-5348bc14e92b on hv-cinder-83009 Mar 08 19:19:33.723881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-7cd0582b-6aea-4ad8-96ef-326ca658903f req-85a13a88-c7cf-4cc9-9c06-9877c42813c1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049099 Mar 08 19:19:33.725467 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 331/674] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:34.075117 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:34.076372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:34.087859 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:34.088601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:34.089624 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:34.090724 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:34.134320 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:34.135085 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:34.135762 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lazy-loading 'fault' on Instance uuid 8644e465-6137-4694-97d5-5348bc14e92b {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:19:34.190501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:34.200378 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e738696e-0cf6-4f14-8919-2abb99cbcd3e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 200 len: 1330 microversion: 2.1 time: 0.129514 Mar 08 19:19:34.202885 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 344/675] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:34 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 1330 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:34.274841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2fb5df48-316d-4b5a-ad80-45b787af44c7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:34.276770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2fb5df48-316d-4b5a-ad80-45b787af44c7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:34.290090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2fb5df48-316d-4b5a-ad80-45b787af44c7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:34.291567 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2fb5df48-316d-4b5a-ad80-45b787af44c7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:34.292586 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2fb5df48-316d-4b5a-ad80-45b787af44c7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:34.293662 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2fb5df48-316d-4b5a-ad80-45b787af44c7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:34.585507 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2fb5df48-316d-4b5a-ad80-45b787af44c7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:34.597183 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2fb5df48-316d-4b5a-ad80-45b787af44c7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.325850 Mar 08 19:19:34.607984 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 332/676] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:34 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:35.222809 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:35.224285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:35.249293 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:35.250178 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:35.252497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:35.253183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:35.285494 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 8644e465-6137-4694-97d5-5348bc14e92b could not be found. Mar 08 19:19:35.286478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 8644e465-6137-4694-97d5-5348bc14e92b could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:19:35.287833 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3b9c35da-3f2b-4f63-94ca-dfeb771be7a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 404 len: 111 microversion: 2.1 time: 0.070382 Mar 08 19:19:35.288973 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 345/677] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:35 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:19:35.302280 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d27d806f-e58b-4857-ac7f-147eb3a0613a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '.version_select at 0x7f4383781700>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:35.439847 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d27d806f-e58b-4857-ac7f-147eb3a0613a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-128913314" status: 202 len: 0 microversion: 2.1 time: 0.144545 Mar 08 19:19:35.441616 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 333/678] 10.222.0.75 () {58 vars in 1217 bytes} [Tue Mar 8 19:19:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-128913314 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:19:35.615094 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4ff1844e-7f9f-4991-9d42-a518f1eb785e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:35.615987 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4ff1844e-7f9f-4991-9d42-a518f1eb785e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:35.630129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ff1844e-7f9f-4991-9d42-a518f1eb785e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:35.630600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ff1844e-7f9f-4991-9d42-a518f1eb785e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:35.631412 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ff1844e-7f9f-4991-9d42-a518f1eb785e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:35.631860 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ff1844e-7f9f-4991-9d42-a518f1eb785e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:35.993702 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4ff1844e-7f9f-4991-9d42-a518f1eb785e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:36.013533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4ff1844e-7f9f-4991-9d42-a518f1eb785e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.400672 Mar 08 19:19:36.013533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 346/679] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:35 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:36.745223 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9d5afca3-25d7-407f-895d-43e4a11f055d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:36.747024 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9d5afca3-25d7-407f-895d-43e4a11f055d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:36.759127 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d5afca3-25d7-407f-895d-43e4a11f055d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:36.759960 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d5afca3-25d7-407f-895d-43e4a11f055d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:36.760981 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d5afca3-25d7-407f-895d-43e4a11f055d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:36.761643 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d5afca3-25d7-407f-895d-43e4a11f055d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:36.878286 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-9d5afca3-25d7-407f-895d-43e4a11f055d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lazy-loading 'services' on Instance uuid 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:19:37.030004 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fc22777e-41d6-493a-ae1a-f620bea6ee41 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:37.030630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fc22777e-41d6-493a-ae1a-f620bea6ee41 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:37.038034 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fc22777e-41d6-493a-ae1a-f620bea6ee41 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:37.042836 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fc22777e-41d6-493a-ae1a-f620bea6ee41 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:37.042836 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fc22777e-41d6-493a-ae1a-f620bea6ee41 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:37.042836 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fc22777e-41d6-493a-ae1a-f620bea6ee41 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:37.109571 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9d5afca3-25d7-407f-895d-43e4a11f055d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-volume_attachments/25b041f7-1519-4106-b55f-ac29e93a93ae" status: 202 len: 0 microversion: 2.1 time: 0.366810 Mar 08 19:19:37.110389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 334/680] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:19:36 2022] DELETE /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-volume_attachments/25b041f7-1519-4106-b55f-ac29e93a93ae => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:19:37.127474 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b72e63f9-d76a-4e63-9454-3acd7658b334 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:37.128879 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b72e63f9-d76a-4e63-9454-3acd7658b334 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:37.142263 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b72e63f9-d76a-4e63-9454-3acd7658b334 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:37.143593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b72e63f9-d76a-4e63-9454-3acd7658b334 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:37.153616 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b72e63f9-d76a-4e63-9454-3acd7658b334 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:37.154387 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b72e63f9-d76a-4e63-9454-3acd7658b334 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:37.217438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fc22777e-41d6-493a-ae1a-f620bea6ee41 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:37.227816 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fc22777e-41d6-493a-ae1a-f620bea6ee41 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.201771 Mar 08 19:19:37.228445 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 347/681] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:37 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:37.254965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b72e63f9-d76a-4e63-9454-3acd7658b334 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139344 Mar 08 19:19:37.255792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 335/682] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:19:37 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:38.254152 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5d9ebb8e-13dc-4218-a60a-0df03383a0d1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:38.254728 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5d9ebb8e-13dc-4218-a60a-0df03383a0d1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:38.261681 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5d9ebb8e-13dc-4218-a60a-0df03383a0d1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:38.262135 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5d9ebb8e-13dc-4218-a60a-0df03383a0d1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:38.270474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5d9ebb8e-13dc-4218-a60a-0df03383a0d1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:38.270474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5d9ebb8e-13dc-4218-a60a-0df03383a0d1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:38.270690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-456b5940-07d7-4372-9482-764c725ea681 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:38.270690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-456b5940-07d7-4372-9482-764c725ea681 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:38.283196 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-456b5940-07d7-4372-9482-764c725ea681 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:38.283649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-456b5940-07d7-4372-9482-764c725ea681 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:38.284552 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-456b5940-07d7-4372-9482-764c725ea681 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:38.291280 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-456b5940-07d7-4372-9482-764c725ea681 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:38.340405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-456b5940-07d7-4372-9482-764c725ea681 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070232 Mar 08 19:19:38.340405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 336/683] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:19:38 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 08 19:19:38.403520 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-835a4b75-cb51-4ea7-9141-5cbea4e4a0c2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:38.404240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-835a4b75-cb51-4ea7-9141-5cbea4e4a0c2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:38.414755 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-835a4b75-cb51-4ea7-9141-5cbea4e4a0c2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:38.415311 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-835a4b75-cb51-4ea7-9141-5cbea4e4a0c2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:38.416977 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-835a4b75-cb51-4ea7-9141-5cbea4e4a0c2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:38.417544 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-835a4b75-cb51-4ea7-9141-5cbea4e4a0c2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:38.433170 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5d9ebb8e-13dc-4218-a60a-0df03383a0d1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:38.441564 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5d9ebb8e-13dc-4218-a60a-0df03383a0d1 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.195654 Mar 08 19:19:38.442133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 348/684] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:38 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:38.446238 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-835a4b75-cb51-4ea7-9141-5cbea4e4a0c2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Going to try to terminate instance {{(pid=117390) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:19:38.633335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7a464b07-e3e5-41a9-9d97-e2e74c48fa9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Action: 'create', calling method: .version_select at 0x7f4383eb15e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-828483359"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:38.649062 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-7a464b07-e3e5-41a9-9d97-e2e74c48fa9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Getting quotas for project 8493e87c10e641d683d44e78c2f7c51b. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:38.653124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-7a464b07-e3e5-41a9-9d97-e2e74c48fa9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Getting quotas for user 4a3d5cc6203f43c8abd03abc42b65915 and project 8493e87c10e641d683d44e78c2f7c51b. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:38.774420 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-835a4b75-cb51-4ea7-9141-5cbea4e4a0c2 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 204 len: 0 microversion: 2.1 time: 0.374965 Mar 08 19:19:38.775408 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 337/685] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:19:38 2022] DELETE /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 19:19:38.790260 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6a093e08-fb17-4e00-832b-ef9fadb402be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:38.791007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6a093e08-fb17-4e00-832b-ef9fadb402be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:38.798816 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a093e08-fb17-4e00-832b-ef9fadb402be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:38.799463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a093e08-fb17-4e00-832b-ef9fadb402be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:38.800288 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a093e08-fb17-4e00-832b-ef9fadb402be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:38.800727 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a093e08-fb17-4e00-832b-ef9fadb402be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:38.967769 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6a093e08-fb17-4e00-832b-ef9fadb402be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:38.976364 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6a093e08-fb17-4e00-832b-ef9fadb402be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1678 microversion: 2.1 time: 0.196210 Mar 08 19:19:38.977142 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 338/686] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:38 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:39.121929 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-7a464b07-e3e5-41a9-9d97-e2e74c48fa9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Getting quotas for project 8493e87c10e641d683d44e78c2f7c51b. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:39.126849 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-7a464b07-e3e5-41a9-9d97-e2e74c48fa9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Getting quotas for user 4a3d5cc6203f43c8abd03abc42b65915 and project 8493e87c10e641d683d44e78c2f7c51b. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:39.140566 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7a464b07-e3e5-41a9-9d97-e2e74c48fa9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.511049 Mar 08 19:19:39.141162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 349/687] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:19:38 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:39.239085 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9978fc75-862f-4136-8917-d2bdc75a5351 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:39.239589 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9978fc75-862f-4136-8917-d2bdc75a5351 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:39.249447 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9978fc75-862f-4136-8917-d2bdc75a5351 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.249948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-538022361", "imageRef": "60fb09a2-befc-4a07-93ef-847dc87fb1a2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-828483359", "networks": [{"uuid": "e2a253e9-bf22-41bc-ad81-8ecedb1c4b93"}]}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:39.250089 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9978fc75-862f-4136-8917-d2bdc75a5351 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.250798 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9978fc75-862f-4136-8917-d2bdc75a5351 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.251969 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9978fc75-862f-4136-8917-d2bdc75a5351 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.289563 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9978fc75-862f-4136-8917-d2bdc75a5351 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments/e4a3ecb9-ba3d-4fd3-bf30-fe6a069f1fc2" status: 200 len: 194 microversion: 2.20 time: 0.303133 Mar 08 19:19:39.290401 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 339/688] 10.222.0.75 () {60 vars in 1453 bytes} [Tue Mar 8 19:19:38 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments/e4a3ecb9-ba3d-4fd3-bf30-fe6a069f1fc2 => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:19:39.307457 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] validate_networks() for [('e2a253e9-bf22-41bc-ad81-8ecedb1c4b93', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:19:39.361516 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-12d37b5a-2b29-4457-bad3-8fa15ecc01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:39.362148 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-12d37b5a-2b29-4457-bad3-8fa15ecc01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:39.368746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-12d37b5a-2b29-4457-bad3-8fa15ecc01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.369229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-12d37b5a-2b29-4457-bad3-8fa15ecc01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.370010 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-12d37b5a-2b29-4457-bad3-8fa15ecc01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.370450 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-12d37b5a-2b29-4457-bad3-8fa15ecc01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.455286 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-12d37b5a-2b29-4457-bad3-8fa15ecc01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lazy-loading 'services' on Instance uuid c1d4ea86-f489-4d6d-995e-1999c95b744d {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:19:39.686384 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-12d37b5a-2b29-4457-bad3-8fa15ecc01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments/e4a3ecb9-ba3d-4fd3-bf30-fe6a069f1fc2" status: 202 len: 0 microversion: 2.20 time: 0.329232 Mar 08 19:19:39.687319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 340/689] 10.222.0.75 () {60 vars in 1456 bytes} [Tue Mar 8 19:19:39 2022] DELETE /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments/e4a3ecb9-ba3d-4fd3-bf30-fe6a069f1fc2 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 08 19:19:39.693348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2631f5bc-ebef-402e-85d1-42072580466e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:39.694315 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2631f5bc-ebef-402e-85d1-42072580466e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:39.700859 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2631f5bc-ebef-402e-85d1-42072580466e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.701336 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2631f5bc-ebef-402e-85d1-42072580466e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.702095 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2631f5bc-ebef-402e-85d1-42072580466e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.702648 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2631f5bc-ebef-402e-85d1-42072580466e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.884335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:19:39.884758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:19:39.885236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:19:39.885648 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:19:39.886055 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:19:39.896948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.897456 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.898254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.898688 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.917214 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Getting quotas for project 8493e87c10e641d683d44e78c2f7c51b. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:39.925420 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Getting quotas for user 4a3d5cc6203f43c8abd03abc42b65915 and project 8493e87c10e641d683d44e78c2f7c51b. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:39.939265 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:19:39.941666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='60fb09a2-befc-4a07-93ef-847dc87fb1a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:19:39.968275 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2631f5bc-ebef-402e-85d1-42072580466e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:39.976333 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2631f5bc-ebef-402e-85d1-42072580466e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.287477 Mar 08 19:19:39.981472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 341/690] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:39 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:39.981722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2053c1d8-c234-4c78-90ae-5dc1c1269907 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:39.982735 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2053c1d8-c234-4c78-90ae-5dc1c1269907 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:39.990349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2053c1d8-c234-4c78-90ae-5dc1c1269907 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.990967 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2053c1d8-c234-4c78-90ae-5dc1c1269907 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:39.991748 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2053c1d8-c234-4c78-90ae-5dc1c1269907 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:39.992311 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2053c1d8-c234-4c78-90ae-5dc1c1269907 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:40.023823 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2053c1d8-c234-4c78-90ae-5dc1c1269907 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045708 Mar 08 19:19:40.027855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 342/691] 10.222.0.75 () {60 vars in 1342 bytes} [Tue Mar 8 19:19:39 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:19:40.029331 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e339e49a-f2d8-4abf-825f-5f2252077e12 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:40.029948 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e339e49a-f2d8-4abf-825f-5f2252077e12 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:40.038361 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e339e49a-f2d8-4abf-825f-5f2252077e12 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:40.044515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e339e49a-f2d8-4abf-825f-5f2252077e12 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:40.044515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e339e49a-f2d8-4abf-825f-5f2252077e12 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:40.044515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e339e49a-f2d8-4abf-825f-5f2252077e12 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:40.050333 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-826d9d65-2b18-49b5-9449-348b56ba50f1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804158 Mar 08 19:19:40.051506 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 350/692] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 19:19:40.061337 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6506da98-121f-4c4b-9a71-084bb9a2e63e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:40.062143 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6506da98-121f-4c4b-9a71-084bb9a2e63e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:40.147583 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6506da98-121f-4c4b-9a71-084bb9a2e63e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:40.155457 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6506da98-121f-4c4b-9a71-084bb9a2e63e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1257 microversion: 2.1 time: 0.097925 Mar 08 19:19:40.156172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 351/693] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:40 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1257 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:40.329568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e339e49a-f2d8-4abf-825f-5f2252077e12 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:40.337928 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e339e49a-f2d8-4abf-825f-5f2252077e12 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1678 microversion: 2.1 time: 0.311724 Mar 08 19:19:40.338402 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 343/694] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:40 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1678 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:40.996179 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a4f236d9-0728-45b5-98ab-d7115503caaa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:40.996911 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a4f236d9-0728-45b5-98ab-d7115503caaa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:41.004136 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a4f236d9-0728-45b5-98ab-d7115503caaa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.004586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a4f236d9-0728-45b5-98ab-d7115503caaa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.005361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a4f236d9-0728-45b5-98ab-d7115503caaa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.005800 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a4f236d9-0728-45b5-98ab-d7115503caaa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.037694 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-18676150-5916-4eeb-9f17-a70e6bdb941a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:41.037694 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-18676150-5916-4eeb-9f17-a70e6bdb941a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:41.042540 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-18676150-5916-4eeb-9f17-a70e6bdb941a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.043237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-18676150-5916-4eeb-9f17-a70e6bdb941a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.044237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-18676150-5916-4eeb-9f17-a70e6bdb941a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.044826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-18676150-5916-4eeb-9f17-a70e6bdb941a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.075121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-18676150-5916-4eeb-9f17-a70e6bdb941a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044222 Mar 08 19:19:41.075684 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 344/695] 10.222.0.75 () {60 vars in 1342 bytes} [Tue Mar 8 19:19:41 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:41.149219 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2e4ba028-32c3-49ba-8e61-93ce79babb59 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:41.150051 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2e4ba028-32c3-49ba-8e61-93ce79babb59 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:41.160091 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e4ba028-32c3-49ba-8e61-93ce79babb59 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.160816 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e4ba028-32c3-49ba-8e61-93ce79babb59 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.161792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e4ba028-32c3-49ba-8e61-93ce79babb59 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.162414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e4ba028-32c3-49ba-8e61-93ce79babb59 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.208939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2e4ba028-32c3-49ba-8e61-93ce79babb59 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Going to try to terminate instance {{(pid=117390) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:19:41.283651 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a4f236d9-0728-45b5-98ab-d7115503caaa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:41.295597 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a4f236d9-0728-45b5-98ab-d7115503caaa tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.305409 Mar 08 19:19:41.300380 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 352/696] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:40 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:41.325321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0bf0896b-7513-40af-af8a-089ebeef0fc2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:41.326872 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0bf0896b-7513-40af-af8a-089ebeef0fc2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:41.345651 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0bf0896b-7513-40af-af8a-089ebeef0fc2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.346675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0bf0896b-7513-40af-af8a-089ebeef0fc2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.348312 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0bf0896b-7513-40af-af8a-089ebeef0fc2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.349359 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0bf0896b-7513-40af-af8a-089ebeef0fc2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.460338 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2e4ba028-32c3-49ba-8e61-93ce79babb59 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 204 len: 0 microversion: 2.20 time: 0.314592 Mar 08 19:19:41.461154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 345/697] 10.222.0.75 () {60 vars in 1279 bytes} [Tue Mar 8 19:19:41 2022] DELETE /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 08 19:19:41.472612 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0bf0896b-7513-40af-af8a-089ebeef0fc2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:41.473345 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-a78fd9f8-26a2-4c42-83b4-b17cf4f2ab89 req-1ce085cd-bd62-439d-a1e1-0551bfbe5b4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d780bbf-4e05-4ac6-8b04-8e55b2b8b873", "name": "network-vif-deleted", "tag": "af2c1b42-45a5-46ce-aea2-d905ce39d3d0"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:41.486535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0bf0896b-7513-40af-af8a-089ebeef0fc2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1261 microversion: 2.1 time: 0.168505 Mar 08 19:19:41.487793 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 353/698] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:41 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:41.488568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-a78fd9f8-26a2-4c42-83b4-b17cf4f2ab89 req-1ce085cd-bd62-439d-a1e1-0551bfbe5b4e service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.489152 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-a78fd9f8-26a2-4c42-83b4-b17cf4f2ab89 req-1ce085cd-bd62-439d-a1e1-0551bfbe5b4e service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.493364 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d1fbf96f-66b8-420e-9ff4-f7ddc891ee80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:41.493971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d1fbf96f-66b8-420e-9ff4-f7ddc891ee80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:41.500584 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d1fbf96f-66b8-420e-9ff4-f7ddc891ee80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.501445 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d1fbf96f-66b8-420e-9ff4-f7ddc891ee80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.502460 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d1fbf96f-66b8-420e-9ff4-f7ddc891ee80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.503182 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d1fbf96f-66b8-420e-9ff4-f7ddc891ee80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.512205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-a78fd9f8-26a2-4c42-83b4-b17cf4f2ab89 req-1ce085cd-bd62-439d-a1e1-0551bfbe5b4e service nova] Creating event network-vif-deleted:af2c1b42-45a5-46ce-aea2-d905ce39d3d0 for instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 on hv-cinder-83009 Mar 08 19:19:41.521060 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-a78fd9f8-26a2-4c42-83b4-b17cf4f2ab89 req-1ce085cd-bd62-439d-a1e1-0551bfbe5b4e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051885 Mar 08 19:19:41.521060 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 346/699] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:41.525014 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:41.525747 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:41.534426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.534426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.534426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:41.534808 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:41.583288 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d1fbf96f-66b8-420e-9ff4-f7ddc891ee80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:41.593363 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d1fbf96f-66b8-420e-9ff4-f7ddc891ee80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 200 len: 1325 microversion: 2.1 time: 0.104205 Mar 08 19:19:41.596175 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 354/700] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:41 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 1325 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:41.708258 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:41.716975 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:41.719094 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:41.719732 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5bf11eb3-feb6-414e-a66a-dfc1e62daff2 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.199761 Mar 08 19:19:41.721979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 347/701] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:41 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:19:42.323707 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f66f2ea7-18af-4ef4-b5b7-46026f607213 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:42.324578 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f66f2ea7-18af-4ef4-b5b7-46026f607213 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:42.335071 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f66f2ea7-18af-4ef4-b5b7-46026f607213 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:42.336102 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f66f2ea7-18af-4ef4-b5b7-46026f607213 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:42.337695 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f66f2ea7-18af-4ef4-b5b7-46026f607213 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:42.338677 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f66f2ea7-18af-4ef4-b5b7-46026f607213 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:42.506090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-92064095-bbcf-4860-a6f7-373d950ce75d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:42.506771 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-92064095-bbcf-4860-a6f7-373d950ce75d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:42.513856 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-92064095-bbcf-4860-a6f7-373d950ce75d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:42.514303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-92064095-bbcf-4860-a6f7-373d950ce75d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:42.515295 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-92064095-bbcf-4860-a6f7-373d950ce75d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:42.515723 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-92064095-bbcf-4860-a6f7-373d950ce75d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:42.635855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-92064095-bbcf-4860-a6f7-373d950ce75d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:42.644185 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-92064095-bbcf-4860-a6f7-373d950ce75d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1327 microversion: 2.1 time: 0.141697 Mar 08 19:19:42.645028 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 348/702] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:42 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1327 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:42.650645 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f66f2ea7-18af-4ef4-b5b7-46026f607213 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:42.657738 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f66f2ea7-18af-4ef4-b5b7-46026f607213 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.337421 Mar 08 19:19:42.668546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:42.668546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:42.668546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:42.668546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:42.669617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:42.669851 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 355/703] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:42 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:42.670046 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:42.689500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 could not be found. Mar 08 19:19:42.690112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:19:42.690942 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bc49d139-3486-49ec-8824-afa27459ec60 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 404 len: 111 microversion: 2.1 time: 0.034830 Mar 08 19:19:42.691495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 349/704] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:42 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:19:42.699871 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ad0fd906-3ed1-4b78-89ad-4a7f1cbc7c56 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '.version_select at 0x7f4383feb940>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:42.739349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:42.739997 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:42.745945 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:42.746426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:42.747738 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:42.748014 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:42.790741 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ad0fd906-3ed1-4b78-89ad-4a7f1cbc7c56 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652189939" status: 202 len: 0 microversion: 2.1 time: 0.094633 Mar 08 19:19:42.791594 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 356/705] 10.222.0.75 () {58 vars in 1220 bytes} [Tue Mar 8 19:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1652189939 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:19:43.038746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:43.065676 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:43.071437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:43.073247 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-653d45ed-53da-4571-8bb7-f1270f9942cb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.338196 Mar 08 19:19:43.081742 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 350/706] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:42 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:19:43.667292 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-349a0e16-2895-4486-b84d-ecb44894f574 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:43.668777 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-349a0e16-2895-4486-b84d-ecb44894f574 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:43.679194 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6e84e8bb-c863-43e1-b2fb-22f0f658d051 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:43.679783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6e84e8bb-c863-43e1-b2fb-22f0f658d051 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:43.693976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-349a0e16-2895-4486-b84d-ecb44894f574 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:43.693976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-349a0e16-2895-4486-b84d-ecb44894f574 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:43.693976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-349a0e16-2895-4486-b84d-ecb44894f574 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:43.693976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-349a0e16-2895-4486-b84d-ecb44894f574 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:43.697100 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e84e8bb-c863-43e1-b2fb-22f0f658d051 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:43.724852 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e84e8bb-c863-43e1-b2fb-22f0f658d051 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:43.725981 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e84e8bb-c863-43e1-b2fb-22f0f658d051 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:43.729413 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e84e8bb-c863-43e1-b2fb-22f0f658d051 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:44.710059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-349a0e16-2895-4486-b84d-ecb44894f574 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:44.718115 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-349a0e16-2895-4486-b84d-ecb44894f574 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 1.057169 Mar 08 19:19:44.719103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 357/707] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:43 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:44.724809 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:44.725781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:44.731095 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6e84e8bb-c863-43e1-b2fb-22f0f658d051 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:44.757145 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:44.758246 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:44.760671 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6e84e8bb-c863-43e1-b2fb-22f0f658d051 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 1.078201 Mar 08 19:19:44.762047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:44.763688 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 351/708] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:43 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:44.768812 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b1dfb7fb-b89c-4080-9f8d-cad62cb521b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: .version_select at 0x7f43837a6790>, body: {"keypair": {"name": "tempest-keypair-993428842"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:44.769136 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:44.814644 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-b1dfb7fb-b89c-4080-9f8d-cad62cb521b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:44.819520 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-b1dfb7fb-b89c-4080-9f8d-cad62cb521b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:45.181969 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:45.191598 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:45.209397 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:45.210908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7fab41b2-dcba-44f9-bfac-e2b8fd8bd3e4 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1724 microversion: 2.20 time: 0.490058 Mar 08 19:19:45.214666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 358/709] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:44 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:19:45.567820 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-b1dfb7fb-b89c-4080-9f8d-cad62cb521b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:45.574126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-b1dfb7fb-b89c-4080-9f8d-cad62cb521b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:45.612267 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b1dfb7fb-b89c-4080-9f8d-cad62cb521b0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.842633 Mar 08 19:19:45.618028 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 352/710] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:19:44 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:45.745738 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-dafb69fd-a2a5-4089-a871-6f2ca260f665 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:45.747566 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-dafb69fd-a2a5-4089-a871-6f2ca260f665 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:45.761100 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dafb69fd-a2a5-4089-a871-6f2ca260f665 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:45.761892 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dafb69fd-a2a5-4089-a871-6f2ca260f665 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:45.763389 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dafb69fd-a2a5-4089-a871-6f2ca260f665 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:45.764614 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dafb69fd-a2a5-4089-a871-6f2ca260f665 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:45.791528 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1cbe89fa-12fd-4129-afe5-534a680b2999 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:45.792327 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1cbe89fa-12fd-4129-afe5-534a680b2999 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:45.806924 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1cbe89fa-12fd-4129-afe5-534a680b2999 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:45.807968 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1cbe89fa-12fd-4129-afe5-534a680b2999 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:45.810885 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1cbe89fa-12fd-4129-afe5-534a680b2999 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:45.810885 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1cbe89fa-12fd-4129-afe5-534a680b2999 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:46.322812 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-dafb69fd-a2a5-4089-a871-6f2ca260f665 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:46.359843 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-dafb69fd-a2a5-4089-a871-6f2ca260f665 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.619925 Mar 08 19:19:46.363831 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 359/711] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:45 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:46.384730 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-8260ef94-327c-43e7-b7b8-a52746787427 req-bf6b83d0-0396-4832-9b95-8d7e829b57c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04abbb21-ab32-456a-b9e5-eda0284c067c", "tag": "ffb7e097-a3bb-4d3a-8540-5b1eda1926a0"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:46.408644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-8260ef94-327c-43e7-b7b8-a52746787427 req-bf6b83d0-0396-4832-9b95-8d7e829b57c8 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:46.411181 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-8260ef94-327c-43e7-b7b8-a52746787427 req-bf6b83d0-0396-4832-9b95-8d7e829b57c8 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:46.431705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1cbe89fa-12fd-4129-afe5-534a680b2999 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:46.452813 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1cbe89fa-12fd-4129-afe5-534a680b2999 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.666351 Mar 08 19:19:46.460290 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 353/712] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:45 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:46.465552 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-8260ef94-327c-43e7-b7b8-a52746787427 req-bf6b83d0-0396-4832-9b95-8d7e829b57c8 service nova] Creating event network-changed:ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 for instance 04abbb21-ab32-456a-b9e5-eda0284c067c on hv-cinder-83009 Mar 08 19:19:46.480326 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:46.482974 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:46.483235 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-8260ef94-327c-43e7-b7b8-a52746787427 req-bf6b83d0-0396-4832-9b95-8d7e829b57c8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117469 Mar 08 19:19:46.484263 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 360/713] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:46.504167 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:46.505892 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:46.507251 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:46.507980 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:46.602826 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:46.620830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:46.625108 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:46.627972 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6a1261a7-62f1-4159-a259-9e600bf4d172 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1657 microversion: 2.20 time: 0.166319 Mar 08 19:19:46.631204 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 354/714] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:46 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1657 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:19:47.389837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-988dbb6f-4bb2-4d12-8693-fe9624712399 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:47.392098 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-988dbb6f-4bb2-4d12-8693-fe9624712399 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:47.401542 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-988dbb6f-4bb2-4d12-8693-fe9624712399 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:47.402432 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-988dbb6f-4bb2-4d12-8693-fe9624712399 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:47.404675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-988dbb6f-4bb2-4d12-8693-fe9624712399 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:47.405236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-988dbb6f-4bb2-4d12-8693-fe9624712399 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:47.474064 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-22073970-3141-4c28-a348-09acb942927e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:47.477943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-22073970-3141-4c28-a348-09acb942927e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:47.487420 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-22073970-3141-4c28-a348-09acb942927e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:47.488295 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-22073970-3141-4c28-a348-09acb942927e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:47.490240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-22073970-3141-4c28-a348-09acb942927e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:47.491273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-22073970-3141-4c28-a348-09acb942927e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:47.674704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-988dbb6f-4bb2-4d12-8693-fe9624712399 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:47.692033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-988dbb6f-4bb2-4d12-8693-fe9624712399 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.304500 Mar 08 19:19:47.693016 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 361/715] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:47 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:47.706842 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:47.707475 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:47.738675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:47.739233 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:47.740122 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:47.740621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:47.816944 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:47.829440 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:47.831750 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lazy-loading 'fault' on Instance uuid c1d4ea86-f489-4d6d-995e-1999c95b744d {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:19:47.911894 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:47.927324 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-22073970-3141-4c28-a348-09acb942927e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:47.930881 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:47.938036 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:47.941508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-22073970-3141-4c28-a348-09acb942927e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.473361 Mar 08 19:19:47.952047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-afa89ad4-d29b-45c4-b6e1-71582818333c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 200 len: 1372 microversion: 2.20 time: 0.248803 Mar 08 19:19:47.952047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 362/716] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:47 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:19:47.956288 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 355/717] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:47 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:48.535148 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-29bbada2-c11d-4eec-b58b-d0ae0aea79ae req-27112724-ff52-4bbb-8de7-79c94b7043d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1d4ea86-f489-4d6d-995e-1999c95b744d", "name": "network-vif-deleted", "tag": "73344e8e-b327-42b5-a317-814f95b92074"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:48.553527 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-29bbada2-c11d-4eec-b58b-d0ae0aea79ae req-27112724-ff52-4bbb-8de7-79c94b7043d4 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:48.554511 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-29bbada2-c11d-4eec-b58b-d0ae0aea79ae req-27112724-ff52-4bbb-8de7-79c94b7043d4 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:48.581675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-29bbada2-c11d-4eec-b58b-d0ae0aea79ae req-27112724-ff52-4bbb-8de7-79c94b7043d4 service nova] Creating event network-vif-deleted:73344e8e-b327-42b5-a317-814f95b92074 for instance c1d4ea86-f489-4d6d-995e-1999c95b744d on hv-cinder-83009 Mar 08 19:19:48.589789 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-29bbada2-c11d-4eec-b58b-d0ae0aea79ae req-27112724-ff52-4bbb-8de7-79c94b7043d4 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059772 Mar 08 19:19:48.595951 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 363/718] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:48.710221 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6e1367ed-4edf-44ef-b044-cad23d91e027 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:48.710840 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6e1367ed-4edf-44ef-b044-cad23d91e027 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:48.721716 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e1367ed-4edf-44ef-b044-cad23d91e027 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:48.722204 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e1367ed-4edf-44ef-b044-cad23d91e027 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:48.722973 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e1367ed-4edf-44ef-b044-cad23d91e027 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:48.723405 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e1367ed-4edf-44ef-b044-cad23d91e027 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:48.963853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-72f1512a-08a4-4ef7-822a-1461ae62cea0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:48.964900 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-72f1512a-08a4-4ef7-822a-1461ae62cea0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:48.974587 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-72f1512a-08a4-4ef7-822a-1461ae62cea0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:48.975329 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-72f1512a-08a4-4ef7-822a-1461ae62cea0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:48.976776 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-72f1512a-08a4-4ef7-822a-1461ae62cea0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:48.977733 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-72f1512a-08a4-4ef7-822a-1461ae62cea0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:49.102856 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6e1367ed-4edf-44ef-b044-cad23d91e027 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:49.111192 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6e1367ed-4edf-44ef-b044-cad23d91e027 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.405277 Mar 08 19:19:49.120844 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 356/719] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:48 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:49.126944 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:49.127953 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:49.135319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:49.136068 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:49.137017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:49.137613 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:49.152994 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] HTTP exception thrown: Instance c1d4ea86-f489-4d6d-995e-1999c95b744d could not be found. Mar 08 19:19:49.153880 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Returning 404 to user: Instance c1d4ea86-f489-4d6d-995e-1999c95b744d could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:19:49.154869 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-486f6f0c-049d-4c08-ae0b-8bf28588198c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 404 len: 111 microversion: 2.20 time: 0.032506 Mar 08 19:19:49.156866 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 357/720] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:49 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:19:49.163028 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2052481696", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eadbce5e-f6fa-402e-acf1-15b1deb0f309"}], "security_groups": [{"name": "tempest-securitygroup--2009613817"}], "key_name": "tempest-keypair-993428842", "user_data": "}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:49.290826 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-72f1512a-08a4-4ef7-822a-1461ae62cea0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:49.303329 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-72f1512a-08a4-4ef7-822a-1461ae62cea0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.345331 Mar 08 19:19:49.304614 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 364/721] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:48 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:49.309624 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3a6e6487-7bd8-4f04-a063-082c0261a59a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '.version_select at 0x7f4383eb1d30>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:49.321556 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] validate_networks() for [('eadbce5e-f6fa-402e-acf1-15b1deb0f309', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:19:49.409220 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3a6e6487-7bd8-4f04-a063-082c0261a59a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334597916" status: 204 len: 0 microversion: 2.20 time: 0.103257 Mar 08 19:19:49.410372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 365/722] 10.222.0.75 () {60 vars in 1261 bytes} [Tue Mar 8 19:19:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1334597916 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 19:19:50.110652 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:19:50.112246 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:19:50.112246 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:19:50.112631 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:19:50.113259 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:19:50.129190 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a7ef5013-8435-4fa9-b187-bd8d93b5efdd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:50.130994 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a7ef5013-8435-4fa9-b187-bd8d93b5efdd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:50.134640 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:50.135452 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:50.141839 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:50.156205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:50.156368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a7ef5013-8435-4fa9-b187-bd8d93b5efdd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:50.156368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a7ef5013-8435-4fa9-b187-bd8d93b5efdd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:50.156368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a7ef5013-8435-4fa9-b187-bd8d93b5efdd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:50.156368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a7ef5013-8435-4fa9-b187-bd8d93b5efdd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:50.202186 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:50.210511 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:50.250852 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:19:50.252989 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:19:50.680055 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a7ef5013-8435-4fa9-b187-bd8d93b5efdd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:50.691082 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a7ef5013-8435-4fa9-b187-bd8d93b5efdd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.566713 Mar 08 19:19:50.691703 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 366/723] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:50 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:50.701470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6dcd2fb3-501d-4a65-861d-abc8db82760c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:50.701470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6dcd2fb3-501d-4a65-861d-abc8db82760c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:50.708932 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6dcd2fb3-501d-4a65-861d-abc8db82760c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:50.708932 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6dcd2fb3-501d-4a65-861d-abc8db82760c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:50.709787 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6dcd2fb3-501d-4a65-861d-abc8db82760c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:50.710240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6dcd2fb3-501d-4a65-861d-abc8db82760c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:50.894368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6dcd2fb3-501d-4a65-861d-abc8db82760c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:50.902365 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6dcd2fb3-501d-4a65-861d-abc8db82760c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.209610 Mar 08 19:19:50.902944 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 367/724] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:50 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:51.031621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ea469fd2-42fc-4702-a9ed-5f0c9baf0b70 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.873361 Mar 08 19:19:51.037909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 358/725] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:19:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:19:51.061420 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1f3f4bc9-fbaf-4c9d-bc56-74c59c948e2b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:51.068660 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1f3f4bc9-fbaf-4c9d-bc56-74c59c948e2b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:51.183862 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1f3f4bc9-fbaf-4c9d-bc56-74c59c948e2b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:51.195403 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1f3f4bc9-fbaf-4c9d-bc56-74c59c948e2b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1241 microversion: 2.1 time: 0.155280 Mar 08 19:19:51.197057 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 368/726] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:51 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:51.272594 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0a051fc1-fc13-4301-8b96-9ee9b5153e66 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'create', calling method: .version_select at 0x7f43837815e0>, body: {"keypair": {"name": "tempest-keypair-501778886"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:51.291879 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-0a051fc1-fc13-4301-8b96-9ee9b5153e66 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:51.298698 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-0a051fc1-fc13-4301-8b96-9ee9b5153e66 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for user 86324e490e1041088722ab5fc5df4e91 and project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:51.710881 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-64868e4f-e5fe-4481-8929-1ee452735bd4 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:51.712059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-64868e4f-e5fe-4481-8929-1ee452735bd4 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:51.718905 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-64868e4f-e5fe-4481-8929-1ee452735bd4 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:51.720097 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-64868e4f-e5fe-4481-8929-1ee452735bd4 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:51.721285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-64868e4f-e5fe-4481-8929-1ee452735bd4 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:51.721722 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-64868e4f-e5fe-4481-8929-1ee452735bd4 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:51.821501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-0a051fc1-fc13-4301-8b96-9ee9b5153e66 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:51.826810 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-0a051fc1-fc13-4301-8b96-9ee9b5153e66 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for user 86324e490e1041088722ab5fc5df4e91 and project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:51.851455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0a051fc1-fc13-4301-8b96-9ee9b5153e66 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.582827 Mar 08 19:19:51.852594 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 359/727] 10.222.0.75 () {62 vars in 1198 bytes} [Tue Mar 8 19:19:51 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 585 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Mar 08 19:19:51.922179 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-34397920-156f-4a53-b719-327ea2fda0d4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:51.923649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-34397920-156f-4a53-b719-327ea2fda0d4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:51.932049 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-34397920-156f-4a53-b719-327ea2fda0d4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:51.932511 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-34397920-156f-4a53-b719-327ea2fda0d4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:51.933304 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-34397920-156f-4a53-b719-327ea2fda0d4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:51.933743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-34397920-156f-4a53-b719-327ea2fda0d4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:52.211628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-64868e4f-e5fe-4481-8929-1ee452735bd4 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:52.223936 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-64868e4f-e5fe-4481-8929-1ee452735bd4 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.517424 Mar 08 19:19:52.224595 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 369/728] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:51 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:52.229690 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e14aed6e-8505-444a-92f9-2df80642749f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:52.230288 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e14aed6e-8505-444a-92f9-2df80642749f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:52.237656 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e14aed6e-8505-444a-92f9-2df80642749f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:52.238113 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e14aed6e-8505-444a-92f9-2df80642749f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:52.238916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e14aed6e-8505-444a-92f9-2df80642749f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:52.239022 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-34397920-156f-4a53-b719-327ea2fda0d4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:52.239350 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e14aed6e-8505-444a-92f9-2df80642749f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:52.248569 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-34397920-156f-4a53-b719-327ea2fda0d4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.330298 Mar 08 19:19:52.249154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 360/729] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:51 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:52.307116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e14aed6e-8505-444a-92f9-2df80642749f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:52.321205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e14aed6e-8505-444a-92f9-2df80642749f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1245 microversion: 2.1 time: 0.095555 Mar 08 19:19:52.321809 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 370/730] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:52 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:53.241414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d77eca03-8a07-4884-b35c-6dd6657347b8 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:53.243084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d77eca03-8a07-4884-b35c-6dd6657347b8 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:53.252708 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d77eca03-8a07-4884-b35c-6dd6657347b8 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:53.253159 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d77eca03-8a07-4884-b35c-6dd6657347b8 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:53.255690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d77eca03-8a07-4884-b35c-6dd6657347b8 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:53.255690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d77eca03-8a07-4884-b35c-6dd6657347b8 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:53.267805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1d931f37-c36d-423b-b6d2-ef23e7a3b014 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:53.269080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1d931f37-c36d-423b-b6d2-ef23e7a3b014 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:53.279613 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1d931f37-c36d-423b-b6d2-ef23e7a3b014 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:53.280507 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1d931f37-c36d-423b-b6d2-ef23e7a3b014 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:53.282686 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1d931f37-c36d-423b-b6d2-ef23e7a3b014 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:53.282686 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1d931f37-c36d-423b-b6d2-ef23e7a3b014 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:53.479639 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d77eca03-8a07-4884-b35c-6dd6657347b8 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:53.484105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1d931f37-c36d-423b-b6d2-ef23e7a3b014 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:53.488140 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d77eca03-8a07-4884-b35c-6dd6657347b8 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.250669 Mar 08 19:19:53.488777 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 361/731] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:53 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:53.493401 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-47aeee8d-e3a4-4d38-8a66-de7a16f876b6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:53.496348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-47aeee8d-e3a4-4d38-8a66-de7a16f876b6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:53.499396 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1d931f37-c36d-423b-b6d2-ef23e7a3b014 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1679 microversion: 2.1 time: 0.236565 Mar 08 19:19:53.500019 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 371/732] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:53 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1679 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:53.500398 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47aeee8d-e3a4-4d38-8a66-de7a16f876b6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:53.501539 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47aeee8d-e3a4-4d38-8a66-de7a16f876b6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:53.502320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47aeee8d-e3a4-4d38-8a66-de7a16f876b6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:53.502841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-47aeee8d-e3a4-4d38-8a66-de7a16f876b6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:53.569515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-47aeee8d-e3a4-4d38-8a66-de7a16f876b6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:53.579473 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-47aeee8d-e3a4-4d38-8a66-de7a16f876b6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1245 microversion: 2.1 time: 0.087681 Mar 08 19:19:53.579473 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 362/733] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:53 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:53.940523 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-860086726", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cd3ea4fe-bf1a-4952-b0bd-286510901348"}], "security_groups": [{"name": "tempest-securitygroup--805455286"}], "key_name": "tempest-keypair-501778886", "user_data": "}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:54.073985 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] validate_networks() for [('cd3ea4fe-bf1a-4952-b0bd-286510901348', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:19:54.506805 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2203690c-bb2e-449d-85de-36e3072fbefd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:54.507357 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2203690c-bb2e-449d-85de-36e3072fbefd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:54.521321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2203690c-bb2e-449d-85de-36e3072fbefd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.522060 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2203690c-bb2e-449d-85de-36e3072fbefd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.522867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2203690c-bb2e-449d-85de-36e3072fbefd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.523312 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2203690c-bb2e-449d-85de-36e3072fbefd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.545491 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:19:54.546165 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:19:54.546918 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:19:54.547613 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:19:54.548357 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:19:54.557660 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.558410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.559547 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.559857 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.577905 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:19:54.583376 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Getting quotas for user 86324e490e1041088722ab5fc5df4e91 and project efdd81b216bc4091b41a1aec0610c6ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:19:54.595408 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:19:54.597732 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:19:54.670126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2203690c-bb2e-449d-85de-36e3072fbefd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:54.678065 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2203690c-bb2e-449d-85de-36e3072fbefd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.175183 Mar 08 19:19:54.685317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 363/734] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:54 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:54.685317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c2916ea4-17a6-4e66-bfeb-c62b511636a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:54.685317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c2916ea4-17a6-4e66-bfeb-c62b511636a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:54.690871 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c2916ea4-17a6-4e66-bfeb-c62b511636a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.691323 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c2916ea4-17a6-4e66-bfeb-c62b511636a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.692129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c2916ea4-17a6-4e66-bfeb-c62b511636a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.692569 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c2916ea4-17a6-4e66-bfeb-c62b511636a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.746872 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8b372f4b-be4c-42bb-b237-df7f69dd6a38 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.810729 Mar 08 19:19:54.747595 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 372/735] 10.222.0.75 () {62 vars in 1187 bytes} [Tue Mar 8 19:19:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 08 19:19:54.758127 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a6ade9f4-3c0e-48b5-9fd8-fc158116265d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:54.758914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a6ade9f4-3c0e-48b5-9fd8-fc158116265d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:54.765120 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a6ade9f4-3c0e-48b5-9fd8-fc158116265d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.765611 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a6ade9f4-3c0e-48b5-9fd8-fc158116265d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.767023 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a6ade9f4-3c0e-48b5-9fd8-fc158116265d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.767628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a6ade9f4-3c0e-48b5-9fd8-fc158116265d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.850208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a6ade9f4-3c0e-48b5-9fd8-fc158116265d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:54.858894 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a6ade9f4-3c0e-48b5-9fd8-fc158116265d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1293 microversion: 2.1 time: 0.104715 Mar 08 19:19:54.859517 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 373/736] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:54 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:54.877256 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5e9ece08-4496-4b69-abd2-f7962d61d7e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:54.877894 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5e9ece08-4496-4b69-abd2-f7962d61d7e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:54.882126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c2916ea4-17a6-4e66-bfeb-c62b511636a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:54.892623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c2916ea4-17a6-4e66-bfeb-c62b511636a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1656 microversion: 2.1 time: 0.212929 Mar 08 19:19:54.900642 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 364/737] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:54 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1656 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:54.915131 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d78d81f1-e88d-4735-9012-6c51af667203 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:54.923910 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d78d81f1-e88d-4735-9012-6c51af667203 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:54.923910 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d78d81f1-e88d-4735-9012-6c51af667203 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:54.965753 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5e9ece08-4496-4b69-abd2-f7962d61d7e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:54.973984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5e9ece08-4496-4b69-abd2-f7962d61d7e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:54.975900 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5e9ece08-4496-4b69-abd2-f7962d61d7e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:54.977056 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5e9ece08-4496-4b69-abd2-f7962d61d7e8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1280 microversion: 2.20 time: 0.115918 Mar 08 19:19:54.988554 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 374/738] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:54 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:19:54.994091 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d78d81f1-e88d-4735-9012-6c51af667203 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Going to try to start instance {{(pid=117390) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 08 19:19:55.182601 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d78d81f1-e88d-4735-9012-6c51af667203 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/action" status: 202 len: 0 microversion: 2.1 time: 0.272623 Mar 08 19:19:55.183580 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 365/739] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:19:54 2022] POST /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:19:55.193484 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1e248ef8-0ee6-4e3d-8e77-27ce43f1ed09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:55.194357 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1e248ef8-0ee6-4e3d-8e77-27ce43f1ed09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:55.201942 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e248ef8-0ee6-4e3d-8e77-27ce43f1ed09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:55.206483 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e248ef8-0ee6-4e3d-8e77-27ce43f1ed09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:55.206483 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e248ef8-0ee6-4e3d-8e77-27ce43f1ed09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:55.206483 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1e248ef8-0ee6-4e3d-8e77-27ce43f1ed09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:55.468570 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1e248ef8-0ee6-4e3d-8e77-27ce43f1ed09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:55.478454 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1e248ef8-0ee6-4e3d-8e77-27ce43f1ed09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1665 microversion: 2.1 time: 0.290015 Mar 08 19:19:55.484463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 375/740] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:55 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1665 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:55.699015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8c39962e-bcd0-4f0e-b675-c9428c055bcb tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:55.700171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8c39962e-bcd0-4f0e-b675-c9428c055bcb tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:55.708637 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8c39962e-bcd0-4f0e-b675-c9428c055bcb tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:55.709093 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8c39962e-bcd0-4f0e-b675-c9428c055bcb tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:55.709882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8c39962e-bcd0-4f0e-b675-c9428c055bcb tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:55.710373 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8c39962e-bcd0-4f0e-b675-c9428c055bcb tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:55.887242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-66a606a3-5732-4909-893e-b912996194bc tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:55.887869 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-66a606a3-5732-4909-893e-b912996194bc tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:55.911700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-66a606a3-5732-4909-893e-b912996194bc tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:55.912099 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-66a606a3-5732-4909-893e-b912996194bc tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:55.912883 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-66a606a3-5732-4909-893e-b912996194bc tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:55.913319 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-66a606a3-5732-4909-893e-b912996194bc tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:56.029594 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-66a606a3-5732-4909-893e-b912996194bc tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:56.038717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-66a606a3-5732-4909-893e-b912996194bc tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1299 microversion: 2.1 time: 0.156862 Mar 08 19:19:56.039555 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 376/741] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:55 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:56.045423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:56.050298 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:56.055133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:56.055355 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:56.057716 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:56.058166 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:56.073473 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8c39962e-bcd0-4f0e-b675-c9428c055bcb tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:56.083308 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8c39962e-bcd0-4f0e-b675-c9428c055bcb tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.391382 Mar 08 19:19:56.083727 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 366/742] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:55 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:56.147119 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:56.155750 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:56.157406 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:56.158756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-702d2276-a943-4cb8-beb8-a6726f0dc448 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1284 microversion: 2.20 time: 0.117684 Mar 08 19:19:56.159510 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 377/743] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:56 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:19:56.498873 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5ca84815-350b-4920-a754-5bce0cf80193 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:56.500109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5ca84815-350b-4920-a754-5bce0cf80193 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:56.507869 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5ca84815-350b-4920-a754-5bce0cf80193 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:56.508623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5ca84815-350b-4920-a754-5bce0cf80193 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:56.509398 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5ca84815-350b-4920-a754-5bce0cf80193 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:56.509890 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5ca84815-350b-4920-a754-5bce0cf80193 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:56.733015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5ca84815-350b-4920-a754-5bce0cf80193 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:56.746099 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5ca84815-350b-4920-a754-5bce0cf80193 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1665 microversion: 2.1 time: 0.250654 Mar 08 19:19:56.751029 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 367/744] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:56 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1665 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:57.058358 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-172b12e7-da16-43f5-ac49-8239555940ce tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:57.059597 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-172b12e7-da16-43f5-ac49-8239555940ce tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:57.066633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-172b12e7-da16-43f5-ac49-8239555940ce tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:57.067579 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-172b12e7-da16-43f5-ac49-8239555940ce tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:57.071860 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-172b12e7-da16-43f5-ac49-8239555940ce tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:57.071860 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-172b12e7-da16-43f5-ac49-8239555940ce tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:57.100240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ad7b2aa8-a589-4a66-8f0f-bb4c7f4c69a2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:57.101096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ad7b2aa8-a589-4a66-8f0f-bb4c7f4c69a2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:57.107894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ad7b2aa8-a589-4a66-8f0f-bb4c7f4c69a2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:57.108372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ad7b2aa8-a589-4a66-8f0f-bb4c7f4c69a2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:57.109359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ad7b2aa8-a589-4a66-8f0f-bb4c7f4c69a2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:57.110325 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ad7b2aa8-a589-4a66-8f0f-bb4c7f4c69a2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:57.808940 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-172b12e7-da16-43f5-ac49-8239555940ce tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:57.817102 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-172b12e7-da16-43f5-ac49-8239555940ce tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.762798 Mar 08 19:19:57.826693 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 378/745] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:57 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:57.826693 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:57.826693 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:57.830528 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:57.830994 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:57.831794 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:57.832243 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:57.841171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ad7b2aa8-a589-4a66-8f0f-bb4c7f4c69a2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:57.852896 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ad7b2aa8-a589-4a66-8f0f-bb4c7f4c69a2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.756563 Mar 08 19:19:57.853644 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 368/746] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:57 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:57.859220 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2f38153c-12fa-48eb-9592-778da4f3c76d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:57.860319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2f38153c-12fa-48eb-9592-778da4f3c76d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:57.871413 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f38153c-12fa-48eb-9592-778da4f3c76d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:57.875466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f38153c-12fa-48eb-9592-778da4f3c76d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:57.875466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f38153c-12fa-48eb-9592-778da4f3c76d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:57.875466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f38153c-12fa-48eb-9592-778da4f3c76d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:57.914599 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:57.934788 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:57.937213 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:57.937579 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f2dceced-9374-4096-9a4d-e5948923a7be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1338 microversion: 2.20 time: 0.118773 Mar 08 19:19:57.938239 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 379/747] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:57 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1338 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:19:58.248312 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2f38153c-12fa-48eb-9592-778da4f3c76d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:58.257378 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2f38153c-12fa-48eb-9592-778da4f3c76d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1669 microversion: 2.1 time: 0.402496 Mar 08 19:19:58.257968 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 369/748] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:57 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1669 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:58.556567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-2d93258b-6381-4d10-9239-5e99e64f19ea req-822bc059-7686-4e02-8f79-5e3874e0b4db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c138706-751b-40a6-9cd3-9200e0dc36fd", "tag": "5734a3a9-cc72-4bae-8317-bbdde03ac4ac"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:19:58.573603 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-2d93258b-6381-4d10-9239-5e99e64f19ea req-822bc059-7686-4e02-8f79-5e3874e0b4db service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:58.574139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-2d93258b-6381-4d10-9239-5e99e64f19ea req-822bc059-7686-4e02-8f79-5e3874e0b4db service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:58.591487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-2d93258b-6381-4d10-9239-5e99e64f19ea req-822bc059-7686-4e02-8f79-5e3874e0b4db service nova] Creating event network-changed:5734a3a9-cc72-4bae-8317-bbdde03ac4ac for instance 9c138706-751b-40a6-9cd3-9200e0dc36fd on hv-cinder-83009 Mar 08 19:19:58.598238 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-2d93258b-6381-4d10-9239-5e99e64f19ea req-822bc059-7686-4e02-8f79-5e3874e0b4db service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046090 Mar 08 19:19:58.598961 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 380/749] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:19:58.835327 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2633de16-216e-43f2-bfec-96f17507f1a8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:58.836002 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2633de16-216e-43f2-bfec-96f17507f1a8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:58.845801 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2633de16-216e-43f2-bfec-96f17507f1a8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:58.846962 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2633de16-216e-43f2-bfec-96f17507f1a8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:58.847827 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2633de16-216e-43f2-bfec-96f17507f1a8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:58.848323 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2633de16-216e-43f2-bfec-96f17507f1a8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:58.870708 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-abd264d4-dbe4-4f34-aebb-ed4979001e9a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:58.871669 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-abd264d4-dbe4-4f34-aebb-ed4979001e9a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:58.879627 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-abd264d4-dbe4-4f34-aebb-ed4979001e9a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:58.880480 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-abd264d4-dbe4-4f34-aebb-ed4979001e9a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:58.881471 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-abd264d4-dbe4-4f34-aebb-ed4979001e9a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:58.882162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-abd264d4-dbe4-4f34-aebb-ed4979001e9a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:59.382126 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-abd264d4-dbe4-4f34-aebb-ed4979001e9a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:59.386105 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2633de16-216e-43f2-bfec-96f17507f1a8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:59.390811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-abd264d4-dbe4-4f34-aebb-ed4979001e9a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.524250 Mar 08 19:19:59.392529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 381/750] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:58 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:19:59.405743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2633de16-216e-43f2-bfec-96f17507f1a8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.574201 Mar 08 19:19:59.405987 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:19:59.412905 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:19:59.413104 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 370/751] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:19:58 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:19:59.419590 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:59.420171 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:59.421023 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:19:59.421460 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:19:59.767860 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:59.784114 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:59.784114 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:19:59.784114 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a8d5a4de-4703-4cd8-a402-667cf5f63b8e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.386187 Mar 08 19:19:59.784423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 382/752] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:19:59 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:20:00.015348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-2aa06d8e-5987-462c-869e-960aa4a2b4c5 req-3a921572-2383-4606-920c-35cd3dd13c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04abbb21-ab32-456a-b9e5-eda0284c067c", "name": "network-vif-plugged", "status": "completed", "tag": "ffb7e097-a3bb-4d3a-8540-5b1eda1926a0"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:00.026748 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-2aa06d8e-5987-462c-869e-960aa4a2b4c5 req-3a921572-2383-4606-920c-35cd3dd13c54 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:00.029974 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-2aa06d8e-5987-462c-869e-960aa4a2b4c5 req-3a921572-2383-4606-920c-35cd3dd13c54 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:00.045857 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-2aa06d8e-5987-462c-869e-960aa4a2b4c5 req-3a921572-2383-4606-920c-35cd3dd13c54 service nova] Creating event network-vif-plugged:ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 for instance 04abbb21-ab32-456a-b9e5-eda0284c067c on hv-cinder-83009 Mar 08 19:20:00.051329 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-2aa06d8e-5987-462c-869e-960aa4a2b4c5 req-3a921572-2383-4606-920c-35cd3dd13c54 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041498 Mar 08 19:20:00.052746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 371/753] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:00.416295 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-338a60fc-60af-41cb-b76f-4babd6714579 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:00.417032 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-338a60fc-60af-41cb-b76f-4babd6714579 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:00.428521 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-8d68fe5a-39a6-4797-bad4-dfc300a16994 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:00.429743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-8d68fe5a-39a6-4797-bad4-dfc300a16994 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:00.432307 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-338a60fc-60af-41cb-b76f-4babd6714579 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:00.433090 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-338a60fc-60af-41cb-b76f-4babd6714579 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:00.434253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-338a60fc-60af-41cb-b76f-4babd6714579 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:00.434926 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-338a60fc-60af-41cb-b76f-4babd6714579 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:00.441247 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8d68fe5a-39a6-4797-bad4-dfc300a16994 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:00.442022 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8d68fe5a-39a6-4797-bad4-dfc300a16994 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:00.443426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8d68fe5a-39a6-4797-bad4-dfc300a16994 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:00.443880 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-8d68fe5a-39a6-4797-bad4-dfc300a16994 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:00.772982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-338a60fc-60af-41cb-b76f-4babd6714579 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:00.775494 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-8d68fe5a-39a6-4797-bad4-dfc300a16994 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:00.787201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-8d68fe5a-39a6-4797-bad4-dfc300a16994 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.367685 Mar 08 19:20:00.787794 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 372/754] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:00 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:00.789816 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-338a60fc-60af-41cb-b76f-4babd6714579 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.380046 Mar 08 19:20:00.790410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 383/755] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:00 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:00.795262 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-36eff857-9976-4513-8f1e-1eef15f3b47b req-174052f9-5904-4c0e-91c4-f07926b1d2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb629d0-2eab-412c-8995-f16c1538c828", "tag": "2eb86a7d-edd4-4947-9ef9-4da4449b0e1f"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:00.798311 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:00.799136 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:00.805398 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-36eff857-9976-4513-8f1e-1eef15f3b47b req-174052f9-5904-4c0e-91c4-f07926b1d2b7 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:00.805875 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-36eff857-9976-4513-8f1e-1eef15f3b47b req-174052f9-5904-4c0e-91c4-f07926b1d2b7 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:00.812996 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:00.813756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:00.815145 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:00.815797 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:00.822137 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-36eff857-9976-4513-8f1e-1eef15f3b47b req-174052f9-5904-4c0e-91c4-f07926b1d2b7 service nova] Creating event network-changed:2eb86a7d-edd4-4947-9ef9-4da4449b0e1f for instance 2fb629d0-2eab-412c-8995-f16c1538c828 on hv-cinder-83009 Mar 08 19:20:00.828170 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-36eff857-9976-4513-8f1e-1eef15f3b47b req-174052f9-5904-4c0e-91c4-f07926b1d2b7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038152 Mar 08 19:20:00.830126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 373/756] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:01.111045 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:01.119745 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:01.121496 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:01.123814 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-58c244de-0449-45ff-82a2-283649607173 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.329394 Mar 08 19:20:01.124473 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 384/757] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:00 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:20:01.806266 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8f967dfd-cee5-4e2e-93f3-30e6c153cf77 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:01.806901 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c547e487-3158-4d21-a1c6-2771c90bf082 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:01.807306 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8f967dfd-cee5-4e2e-93f3-30e6c153cf77 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:01.807505 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c547e487-3158-4d21-a1c6-2771c90bf082 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:01.814087 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f967dfd-cee5-4e2e-93f3-30e6c153cf77 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:01.814463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c547e487-3158-4d21-a1c6-2771c90bf082 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:01.814579 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f967dfd-cee5-4e2e-93f3-30e6c153cf77 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:01.814833 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c547e487-3158-4d21-a1c6-2771c90bf082 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:01.815298 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f967dfd-cee5-4e2e-93f3-30e6c153cf77 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:01.815608 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c547e487-3158-4d21-a1c6-2771c90bf082 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:01.815780 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8f967dfd-cee5-4e2e-93f3-30e6c153cf77 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:01.816090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c547e487-3158-4d21-a1c6-2771c90bf082 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:02.149268 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c547e487-3158-4d21-a1c6-2771c90bf082 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:02.154278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8f967dfd-cee5-4e2e-93f3-30e6c153cf77 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:02.158078 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c547e487-3158-4d21-a1c6-2771c90bf082 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.356255 Mar 08 19:20:02.160239 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 374/758] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:01 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:02.163948 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:02.164575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:02.170853 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:02.171411 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:02.173116 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:02.173116 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:02.182412 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8f967dfd-cee5-4e2e-93f3-30e6c153cf77 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1357 microversion: 2.1 time: 0.373244 Mar 08 19:20:02.183084 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 385/759] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:01 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1357 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:20:02.568914 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:02.576844 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:02.578403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:02.579531 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1530763f-2849-4f0d-acc6-cf3e64832626 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.419397 Mar 08 19:20:02.580113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 375/760] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:02 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:20:03.176159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ac02d54e-cc6e-48ba-ac75-3ae786c4231d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:03.176700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ac02d54e-cc6e-48ba-ac75-3ae786c4231d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:03.183162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ac02d54e-cc6e-48ba-ac75-3ae786c4231d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.183608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ac02d54e-cc6e-48ba-ac75-3ae786c4231d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.184408 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ac02d54e-cc6e-48ba-ac75-3ae786c4231d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.184836 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ac02d54e-cc6e-48ba-ac75-3ae786c4231d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.200178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1ddc6e39-2a4c-4c35-95be-9d57a96dbdc0 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:03.200792 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1ddc6e39-2a4c-4c35-95be-9d57a96dbdc0 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:03.207716 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ddc6e39-2a4c-4c35-95be-9d57a96dbdc0 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.208188 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ddc6e39-2a4c-4c35-95be-9d57a96dbdc0 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.208969 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ddc6e39-2a4c-4c35-95be-9d57a96dbdc0 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.209403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ddc6e39-2a4c-4c35-95be-9d57a96dbdc0 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.380632 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ac02d54e-cc6e-48ba-ac75-3ae786c4231d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:03.388140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ac02d54e-cc6e-48ba-ac75-3ae786c4231d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.216190 Mar 08 19:20:03.388746 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 386/761] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:03 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:03.404593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1ddc6e39-2a4c-4c35-95be-9d57a96dbdc0 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:03.413095 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1ddc6e39-2a4c-4c35-95be-9d57a96dbdc0 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1547 microversion: 2.1 time: 0.216868 Mar 08 19:20:03.413676 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 376/762] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:03 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1547 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:20:03.429586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-662f2ef4-827e-4a90-8828-e421ca964c88 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:03.430128 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-662f2ef4-827e-4a90-8828-e421ca964c88 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:03.436128 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-662f2ef4-827e-4a90-8828-e421ca964c88 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.436579 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-662f2ef4-827e-4a90-8828-e421ca964c88 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.437347 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-662f2ef4-827e-4a90-8828-e421ca964c88 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.437931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-662f2ef4-827e-4a90-8828-e421ca964c88 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.570964 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-662f2ef4-827e-4a90-8828-e421ca964c88 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:03.579371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-662f2ef4-827e-4a90-8828-e421ca964c88 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1547 microversion: 2.1 time: 0.153167 Mar 08 19:20:03.579978 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 387/763] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:03 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:03.595715 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:03.599272 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:03.600064 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Searching by: {'deleted': False, 'project_id': '8493e87c10e641d683d44e78c2f7c51b'} {{(pid=117390) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 08 19:20:03.602564 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:03.603169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:03.606740 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.607189 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.608024 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.608468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.609635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.610273 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.613747 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.613747 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.709357 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.multi_cell_list [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117390) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 08 19:20:03.755734 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:03.764369 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:03.766622 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:03.768181 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0d6096ea-01b7-4c8a-8cf0-4b8b99a79302 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.169404 Mar 08 19:20:03.768758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 388/764] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:03 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:20:03.814030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b40e5a60-64b0-40e6-b852-acd5ad056b0d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.222552 Mar 08 19:20:03.814610 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 377/765] 10.222.0.75 () {58 vars in 1124 bytes} [Tue Mar 8 19:20:03 2022] GET /compute/v2.1/servers => generated 342 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:03.824792 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c431d129-f518-4ca0-8dcb-738df6ec75dd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:03.825404 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c431d129-f518-4ca0-8dcb-738df6ec75dd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:03.831958 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c431d129-f518-4ca0-8dcb-738df6ec75dd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.832412 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c431d129-f518-4ca0-8dcb-738df6ec75dd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.833192 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c431d129-f518-4ca0-8dcb-738df6ec75dd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:03.833623 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c431d129-f518-4ca0-8dcb-738df6ec75dd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:03.977572 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c431d129-f518-4ca0-8dcb-738df6ec75dd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:03.984922 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c431d129-f518-4ca0-8dcb-738df6ec75dd tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1547 microversion: 2.1 time: 0.163966 Mar 08 19:20:03.985521 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 389/766] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:03 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1547 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:04.405777 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-719e3ca4-049e-4f8d-9c8e-139b5749892e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:04.406385 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-719e3ca4-049e-4f8d-9c8e-139b5749892e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:04.412988 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-719e3ca4-049e-4f8d-9c8e-139b5749892e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:04.413440 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-719e3ca4-049e-4f8d-9c8e-139b5749892e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:04.414228 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-719e3ca4-049e-4f8d-9c8e-139b5749892e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:04.414665 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-719e3ca4-049e-4f8d-9c8e-139b5749892e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:04.563281 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-719e3ca4-049e-4f8d-9c8e-139b5749892e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:04.567817 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-719e3ca4-049e-4f8d-9c8e-139b5749892e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.165795 Mar 08 19:20:04.568525 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 378/767] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:04 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:04.785976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:04.786595 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:04.793392 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:04.793845 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:04.794628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:04.795066 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:04.956918 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:04.965051 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:04.966590 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:04.967722 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-23241c71-4a80-4d5d-a6e2-8295daaa803a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.186054 Mar 08 19:20:04.968311 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 390/768] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:04 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:20:05.588330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3b08c5da-c6fe-47b0-9d96-c3525c710c82 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:05.588330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3b08c5da-c6fe-47b0-9d96-c3525c710c82 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:05.592196 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3b08c5da-c6fe-47b0-9d96-c3525c710c82 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:05.592644 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3b08c5da-c6fe-47b0-9d96-c3525c710c82 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:05.593562 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3b08c5da-c6fe-47b0-9d96-c3525c710c82 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:05.594680 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3b08c5da-c6fe-47b0-9d96-c3525c710c82 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:05.749014 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3b08c5da-c6fe-47b0-9d96-c3525c710c82 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:05.757394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3b08c5da-c6fe-47b0-9d96-c3525c710c82 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.175984 Mar 08 19:20:05.758302 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 379/769] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:05 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:05.849682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-82e04810-2af9-425e-956c-123d0b65fa48 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50afbe78-a522-45a0-befb-1b57e680187c"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:05.850718 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-82e04810-2af9-425e-956c-123d0b65fa48 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:05.857445 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-82e04810-2af9-425e-956c-123d0b65fa48 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:05.857894 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-82e04810-2af9-425e-956c-123d0b65fa48 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:05.858679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-82e04810-2af9-425e-956c-123d0b65fa48 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:05.859116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-82e04810-2af9-425e-956c-123d0b65fa48 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:05.985800 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:05.986574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:05.992804 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:05.993289 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:05.994070 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:05.994508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:06.135685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:06.144598 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:06.158175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:06.158175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-99d09c65-590c-49dc-95e5-1a5001828b70 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.165383 Mar 08 19:20:06.158175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 380/770] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:05 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:20:06.533318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-82e04810-2af9-425e-956c-123d0b65fa48 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "POST /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.686155 Mar 08 19:20:06.533973 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 391/771] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:20:05 2022] POST /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments => generated 194 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:20:06.774803 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9a23e37e-4ae9-4a98-b879-50df04f07db9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:06.775520 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9a23e37e-4ae9-4a98-b879-50df04f07db9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:06.782771 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9a23e37e-4ae9-4a98-b879-50df04f07db9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:06.783302 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9a23e37e-4ae9-4a98-b879-50df04f07db9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:06.784174 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9a23e37e-4ae9-4a98-b879-50df04f07db9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:06.784687 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9a23e37e-4ae9-4a98-b879-50df04f07db9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:06.928541 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9a23e37e-4ae9-4a98-b879-50df04f07db9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:06.936944 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9a23e37e-4ae9-4a98-b879-50df04f07db9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.165999 Mar 08 19:20:06.937512 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 381/772] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:06 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:20:07.167994 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:07.168705 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:07.175616 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:07.176011 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:07.176897 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:07.177334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:07.318097 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:07.326026 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:07.327537 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:07.329264 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f1320812-c047-4367-a94d-5e5318bc356a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.166202 Mar 08 19:20:07.329841 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 392/773] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:07 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:20:07.955322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2d97b6ba-29a4-40d0-8010-0713e19c5ee8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:07.955965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2d97b6ba-29a4-40d0-8010-0713e19c5ee8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:07.962283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2d97b6ba-29a4-40d0-8010-0713e19c5ee8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:07.962737 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2d97b6ba-29a4-40d0-8010-0713e19c5ee8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:07.963516 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2d97b6ba-29a4-40d0-8010-0713e19c5ee8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:07.963993 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2d97b6ba-29a4-40d0-8010-0713e19c5ee8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:08.105959 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2d97b6ba-29a4-40d0-8010-0713e19c5ee8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:08.113625 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2d97b6ba-29a4-40d0-8010-0713e19c5ee8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.163486 Mar 08 19:20:08.114202 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 382/774] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:07 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:08.347478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:08.348036 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:08.354229 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:08.361853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:08.361853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:08.361853 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:08.496399 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:08.504476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:08.505998 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:08.507102 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c80d27b1-ce68-4c79-8abd-579d1d442c90 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.164304 Mar 08 19:20:08.507657 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 393/775] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:08 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:20:09.131818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e35955a3-a822-4584-91a4-7471393eb710 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:09.132486 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e35955a3-a822-4584-91a4-7471393eb710 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:09.139106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e35955a3-a822-4584-91a4-7471393eb710 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:09.139558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e35955a3-a822-4584-91a4-7471393eb710 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:09.140360 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e35955a3-a822-4584-91a4-7471393eb710 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:09.140799 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e35955a3-a822-4584-91a4-7471393eb710 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:09.276554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e35955a3-a822-4584-91a4-7471393eb710 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:09.283961 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e35955a3-a822-4584-91a4-7471393eb710 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.156181 Mar 08 19:20:09.284532 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 383/776] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:09 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:09.525898 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:09.526434 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:09.533400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:09.533846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:09.534619 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:09.535056 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:09.668065 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:09.676861 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:09.678366 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:09.679479 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4f516694-b32a-47b4-970e-02978fd8cc97 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.157586 Mar 08 19:20:09.680094 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 394/777] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:09 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:20:10.015181 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-4536a698-6036-4ed5-ad65-6fc476ac6c39 req-fba81f6b-b4a0-412c-b163-5cbf651268a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb629d0-2eab-412c-8995-f16c1538c828", "name": "network-vif-plugged", "status": "completed", "tag": "2eb86a7d-edd4-4947-9ef9-4da4449b0e1f"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:10.023733 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-4536a698-6036-4ed5-ad65-6fc476ac6c39 req-fba81f6b-b4a0-412c-b163-5cbf651268a1 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:10.024213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-4536a698-6036-4ed5-ad65-6fc476ac6c39 req-fba81f6b-b4a0-412c-b163-5cbf651268a1 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:10.034966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-4536a698-6036-4ed5-ad65-6fc476ac6c39 req-fba81f6b-b4a0-412c-b163-5cbf651268a1 service nova] Creating event network-vif-plugged:2eb86a7d-edd4-4947-9ef9-4da4449b0e1f for instance 2fb629d0-2eab-412c-8995-f16c1538c828 on hv-cinder-83009 Mar 08 19:20:10.040098 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-4536a698-6036-4ed5-ad65-6fc476ac6c39 req-fba81f6b-b4a0-412c-b163-5cbf651268a1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028486 Mar 08 19:20:10.040721 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 384/778] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:10.304152 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cbf17a02-092d-4634-90fc-cc36051cc744 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:10.305281 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cbf17a02-092d-4634-90fc-cc36051cc744 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:10.314399 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cbf17a02-092d-4634-90fc-cc36051cc744 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:10.314851 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cbf17a02-092d-4634-90fc-cc36051cc744 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:10.315664 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cbf17a02-092d-4634-90fc-cc36051cc744 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:10.316133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cbf17a02-092d-4634-90fc-cc36051cc744 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:10.463901 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cbf17a02-092d-4634-90fc-cc36051cc744 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:10.471392 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cbf17a02-092d-4634-90fc-cc36051cc744 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.172879 Mar 08 19:20:10.472005 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 395/779] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:10 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:10.698174 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:10.698867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:10.704968 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:10.705412 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:10.706175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:10.712362 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:10.857963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:10.866875 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:10.868417 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:10.869525 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-69fa8b8d-59d0-474b-b4d5-dd379154b228 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1405 microversion: 2.20 time: 0.176003 Mar 08 19:20:10.870134 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 385/780] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:10 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:20:11.492770 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-10f8f327-1c96-440d-95c7-ec5af2c8731e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:11.493377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-10f8f327-1c96-440d-95c7-ec5af2c8731e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:11.499726 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-10f8f327-1c96-440d-95c7-ec5af2c8731e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:11.500371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-10f8f327-1c96-440d-95c7-ec5af2c8731e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:11.501148 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-10f8f327-1c96-440d-95c7-ec5af2c8731e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:11.501583 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-10f8f327-1c96-440d-95c7-ec5af2c8731e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:11.639551 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-10f8f327-1c96-440d-95c7-ec5af2c8731e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:11.647672 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-10f8f327-1c96-440d-95c7-ec5af2c8731e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.158707 Mar 08 19:20:11.648286 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 396/781] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:11 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:11.889499 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:11.892029 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:11.899201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:11.899663 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:11.900487 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:11.900925 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:12.036773 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:12.044486 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:12.045997 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:12.047227 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-83789e32-47ff-4ab3-b0cf-9a1909556293 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1596 microversion: 2.20 time: 0.161872 Mar 08 19:20:12.047782 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 386/782] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:20:11 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1596 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:20:12.055054 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-eceb1eaa-d09b-42e6-90a2-ff7576d316e5 req-6b95e87f-6c69-49f8-98b2-3c0ea2686df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c138706-751b-40a6-9cd3-9200e0dc36fd", "name": "network-vif-plugged", "status": "completed", "tag": "5734a3a9-cc72-4bae-8317-bbdde03ac4ac"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:12.063590 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-eceb1eaa-d09b-42e6-90a2-ff7576d316e5 req-6b95e87f-6c69-49f8-98b2-3c0ea2686df1 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:12.064059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-eceb1eaa-d09b-42e6-90a2-ff7576d316e5 req-6b95e87f-6c69-49f8-98b2-3c0ea2686df1 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:12.066205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-07879e97-2133-498c-b97f-978c8271cba3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:12.066722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-07879e97-2133-498c-b97f-978c8271cba3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:12.075331 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-eceb1eaa-d09b-42e6-90a2-ff7576d316e5 req-6b95e87f-6c69-49f8-98b2-3c0ea2686df1 service nova] Creating event network-vif-plugged:5734a3a9-cc72-4bae-8317-bbdde03ac4ac for instance 9c138706-751b-40a6-9cd3-9200e0dc36fd on hv-cinder-83009 Mar 08 19:20:12.075785 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07879e97-2133-498c-b97f-978c8271cba3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:12.076286 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07879e97-2133-498c-b97f-978c8271cba3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:12.077056 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07879e97-2133-498c-b97f-978c8271cba3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:12.077488 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-07879e97-2133-498c-b97f-978c8271cba3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:12.081129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-eceb1eaa-d09b-42e6-90a2-ff7576d316e5 req-6b95e87f-6c69-49f8-98b2-3c0ea2686df1 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029637 Mar 08 19:20:12.081801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 397/783] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:12.164390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-07879e97-2133-498c-b97f-978c8271cba3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102519 Mar 08 19:20:12.165037 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 387/784] 10.222.0.75 () {60 vars in 1315 bytes} [Tue Mar 8 19:20:12 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 08 19:20:12.666148 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-aa153ee4-b9d9-4abf-8137-d518e0405027 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:12.666852 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-aa153ee4-b9d9-4abf-8137-d518e0405027 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:12.673526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aa153ee4-b9d9-4abf-8137-d518e0405027 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:12.673977 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aa153ee4-b9d9-4abf-8137-d518e0405027 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:12.674769 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aa153ee4-b9d9-4abf-8137-d518e0405027 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:12.675192 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-aa153ee4-b9d9-4abf-8137-d518e0405027 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:12.811444 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-aa153ee4-b9d9-4abf-8137-d518e0405027 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:12.819085 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-aa153ee4-b9d9-4abf-8137-d518e0405027 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.157674 Mar 08 19:20:12.819661 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 398/785] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:12 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:13.293330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-b582763d-cc5e-4164-be69-5def5739c927 req-9b035202-89ff-496d-b49c-1823f4257c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fb629d0-2eab-412c-8995-f16c1538c828", "tag": "2eb86a7d-edd4-4947-9ef9-4da4449b0e1f"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:13.301852 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-b582763d-cc5e-4164-be69-5def5739c927 req-9b035202-89ff-496d-b49c-1823f4257c34 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:13.302289 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-b582763d-cc5e-4164-be69-5def5739c927 req-9b035202-89ff-496d-b49c-1823f4257c34 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:13.314092 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-b582763d-cc5e-4164-be69-5def5739c927 req-9b035202-89ff-496d-b49c-1823f4257c34 service nova] Creating event network-changed:2eb86a7d-edd4-4947-9ef9-4da4449b0e1f for instance 2fb629d0-2eab-412c-8995-f16c1538c828 on hv-cinder-83009 Mar 08 19:20:13.318868 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-b582763d-cc5e-4164-be69-5def5739c927 req-9b035202-89ff-496d-b49c-1823f4257c34 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097319 Mar 08 19:20:13.319632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 388/786] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:13.836866 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3b9d4a08-5903-4488-99c6-090e86e19bb9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:13.837590 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3b9d4a08-5903-4488-99c6-090e86e19bb9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:13.844166 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3b9d4a08-5903-4488-99c6-090e86e19bb9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:13.845709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3b9d4a08-5903-4488-99c6-090e86e19bb9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:13.845848 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3b9d4a08-5903-4488-99c6-090e86e19bb9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:13.846296 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3b9d4a08-5903-4488-99c6-090e86e19bb9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:14.049218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3b9d4a08-5903-4488-99c6-090e86e19bb9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:14.057041 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3b9d4a08-5903-4488-99c6-090e86e19bb9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1367 microversion: 2.1 time: 0.224005 Mar 08 19:20:14.057716 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 399/787] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:13 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:15.075465 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-816cc839-2c5e-4f39-8391-237b4efc7494 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:15.076219 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-816cc839-2c5e-4f39-8391-237b4efc7494 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:15.083242 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-816cc839-2c5e-4f39-8391-237b4efc7494 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:15.083699 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-816cc839-2c5e-4f39-8391-237b4efc7494 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:15.084508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-816cc839-2c5e-4f39-8391-237b4efc7494 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:15.084945 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-816cc839-2c5e-4f39-8391-237b4efc7494 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:15.209231 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-465e9447-8c5a-4bd1-b215-d56ec918b477 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:15.209844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-465e9447-8c5a-4bd1-b215-d56ec918b477 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:15.216428 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-465e9447-8c5a-4bd1-b215-d56ec918b477 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:15.216961 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-465e9447-8c5a-4bd1-b215-d56ec918b477 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:15.217856 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-465e9447-8c5a-4bd1-b215-d56ec918b477 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:15.218292 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-465e9447-8c5a-4bd1-b215-d56ec918b477 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:15.230175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-816cc839-2c5e-4f39-8391-237b4efc7494 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:15.238590 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-816cc839-2c5e-4f39-8391-237b4efc7494 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1557 microversion: 2.1 time: 0.167772 Mar 08 19:20:15.239166 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 389/788] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:15 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1557 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:20:15.255520 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b8ea8508-c32e-47d3-a731-96e4df1fb420 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:15.256037 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b8ea8508-c32e-47d3-a731-96e4df1fb420 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:15.262291 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8ea8508-c32e-47d3-a731-96e4df1fb420 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:15.262739 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8ea8508-c32e-47d3-a731-96e4df1fb420 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:15.263506 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8ea8508-c32e-47d3-a731-96e4df1fb420 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:15.263958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8ea8508-c32e-47d3-a731-96e4df1fb420 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:15.436738 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b8ea8508-c32e-47d3-a731-96e4df1fb420 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185086 Mar 08 19:20:15.437374 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 390/789] 10.222.0.75 () {58 vars in 1274 bytes} [Tue Mar 8 19:20:15 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:15.467611 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-465e9447-8c5a-4bd1-b215-d56ec918b477 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:15.476144 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-465e9447-8c5a-4bd1-b215-d56ec918b477 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1593 microversion: 2.1 time: 0.270881 Mar 08 19:20:15.476724 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 400/790] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:15 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1593 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:20:16.746444 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-f9e24e5d-6028-476f-a13f-564e08cd7f87 req-571e08e6-fde7-430e-a395-6fa41693b208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c138706-751b-40a6-9cd3-9200e0dc36fd", "tag": "5734a3a9-cc72-4bae-8317-bbdde03ac4ac"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:16.758770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-f9e24e5d-6028-476f-a13f-564e08cd7f87 req-571e08e6-fde7-430e-a395-6fa41693b208 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:16.759411 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-f9e24e5d-6028-476f-a13f-564e08cd7f87 req-571e08e6-fde7-430e-a395-6fa41693b208 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:16.773671 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-f9e24e5d-6028-476f-a13f-564e08cd7f87 req-571e08e6-fde7-430e-a395-6fa41693b208 service nova] Creating event network-changed:5734a3a9-cc72-4bae-8317-bbdde03ac4ac for instance 9c138706-751b-40a6-9cd3-9200e0dc36fd on hv-cinder-83009 Mar 08 19:20:16.779087 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-f9e24e5d-6028-476f-a13f-564e08cd7f87 req-571e08e6-fde7-430e-a395-6fa41693b208 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037451 Mar 08 19:20:16.779959 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 391/791] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:18.328989 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-5ed64d62-5b89-40c6-ae64-ea3eafcae965 req-6072a11a-9b8e-45dd-82ab-1ce939f0e03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04abbb21-ab32-456a-b9e5-eda0284c067c", "tag": "ffb7e097-a3bb-4d3a-8540-5b1eda1926a0"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:18.338421 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-5ed64d62-5b89-40c6-ae64-ea3eafcae965 req-6072a11a-9b8e-45dd-82ab-1ce939f0e03e service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:18.338865 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-5ed64d62-5b89-40c6-ae64-ea3eafcae965 req-6072a11a-9b8e-45dd-82ab-1ce939f0e03e service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:18.352866 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-5ed64d62-5b89-40c6-ae64-ea3eafcae965 req-6072a11a-9b8e-45dd-82ab-1ce939f0e03e service nova] Creating event network-changed:ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 for instance 04abbb21-ab32-456a-b9e5-eda0284c067c on hv-cinder-83009 Mar 08 19:20:18.358076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-5ed64d62-5b89-40c6-ae64-ea3eafcae965 req-6072a11a-9b8e-45dd-82ab-1ce939f0e03e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033204 Mar 08 19:20:18.358669 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 401/792] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:20.463647 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-87e3747f-a495-41e1-9390-b4a0f8eaa377 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-460715053"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:20.464308 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-87e3747f-a495-41e1-9390-b4a0f8eaa377 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:20.471617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-87e3747f-a495-41e1-9390-b4a0f8eaa377 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:20.472125 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-87e3747f-a495-41e1-9390-b4a0f8eaa377 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:20.472882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-87e3747f-a495-41e1-9390-b4a0f8eaa377 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:20.473320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-87e3747f-a495-41e1-9390-b4a0f8eaa377 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:20.604883 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.network.security_group_api [None req-87e3747f-a495-41e1-9390-b4a0f8eaa377 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Adding security group fac173b8-1244-482f-9c3f-ef19a73c1d2c to port ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 Mar 08 19:20:21.016782 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-87e3747f-a495-41e1-9390-b4a0f8eaa377 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "POST /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/action" status: 202 len: 0 microversion: 2.1 time: 0.557583 Mar 08 19:20:21.018497 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 392/793] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:20:20 2022] POST /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:20:21.030395 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c6b37339-305d-4583-81c7-a9651a1b4aa7 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:20:21.031129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c6b37339-305d-4583-81c7-a9651a1b4aa7 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:20:21.033771 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-65741a3e-7fe3-464c-b289-56c001c4e2c3 req-a61b69b7-2532-4878-a634-105e9c27463b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04abbb21-ab32-456a-b9e5-eda0284c067c", "tag": "ffb7e097-a3bb-4d3a-8540-5b1eda1926a0"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:20:21.047515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-65741a3e-7fe3-464c-b289-56c001c4e2c3 req-a61b69b7-2532-4878-a634-105e9c27463b service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:21.049958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c6b37339-305d-4583-81c7-a9651a1b4aa7 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:21.050642 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c6b37339-305d-4583-81c7-a9651a1b4aa7 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:21.051659 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c6b37339-305d-4583-81c7-a9651a1b4aa7 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:20:21.059117 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-65741a3e-7fe3-464c-b289-56c001c4e2c3 req-a61b69b7-2532-4878-a634-105e9c27463b service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:21.065294 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c6b37339-305d-4583-81c7-a9651a1b4aa7 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:20:21.074409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-65741a3e-7fe3-464c-b289-56c001c4e2c3 req-a61b69b7-2532-4878-a634-105e9c27463b service nova] Creating event network-changed:ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 for instance 04abbb21-ab32-456a-b9e5-eda0284c067c on hv-cinder-83009 Mar 08 19:20:21.081292 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-65741a3e-7fe3-464c-b289-56c001c4e2c3 req-a61b69b7-2532-4878-a634-105e9c27463b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058434 Mar 08 19:20:21.082318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 402/794] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:20:21.342514 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c6b37339-305d-4583-81c7-a9651a1b4aa7 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:20:21.353825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c6b37339-305d-4583-81c7-a9651a1b4aa7 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1758 microversion: 2.1 time: 0.327057 Mar 08 19:20:21.354963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 393/795] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:20:21 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1758 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:05.294094 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c3b6368a-5e1d-4bb6-bdb8-d40c41ba897a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:05.295265 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c3b6368a-5e1d-4bb6-bdb8-d40c41ba897a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:05.301684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c3b6368a-5e1d-4bb6-bdb8-d40c41ba897a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:05.302172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c3b6368a-5e1d-4bb6-bdb8-d40c41ba897a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:05.302957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c3b6368a-5e1d-4bb6-bdb8-d40c41ba897a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:05.303395 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c3b6368a-5e1d-4bb6-bdb8-d40c41ba897a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:05.340048 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c3b6368a-5e1d-4bb6-bdb8-d40c41ba897a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050995 Mar 08 19:21:05.340623 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 403/796] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:21:05 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:21:05.398902 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a49c1e4c-a327-4379-a328-c20cbbdaeaff tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:05.399400 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a49c1e4c-a327-4379-a328-c20cbbdaeaff tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:05.405471 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a49c1e4c-a327-4379-a328-c20cbbdaeaff tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:05.405920 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a49c1e4c-a327-4379-a328-c20cbbdaeaff tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:05.406685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a49c1e4c-a327-4379-a328-c20cbbdaeaff tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:05.407116 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a49c1e4c-a327-4379-a328-c20cbbdaeaff tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:05.430689 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a49c1e4c-a327-4379-a328-c20cbbdaeaff tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Going to try to terminate instance {{(pid=117390) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:21:05.708344 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a49c1e4c-a327-4379-a328-c20cbbdaeaff tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 204 len: 0 microversion: 2.1 time: 0.312995 Mar 08 19:21:05.708922 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 394/797] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:21:05 2022] DELETE /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:21:05.717736 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-543246ec-ce17-4eb2-8227-488eef80a634 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:05.718351 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-543246ec-ce17-4eb2-8227-488eef80a634 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:05.724208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-543246ec-ce17-4eb2-8227-488eef80a634 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:05.724659 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-543246ec-ce17-4eb2-8227-488eef80a634 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:05.725423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-543246ec-ce17-4eb2-8227-488eef80a634 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:05.725855 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-543246ec-ce17-4eb2-8227-488eef80a634 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:05.866581 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-543246ec-ce17-4eb2-8227-488eef80a634 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:05.873941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-543246ec-ce17-4eb2-8227-488eef80a634 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1675 microversion: 2.1 time: 0.160686 Mar 08 19:21:05.874501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 404/798] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:05 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:06.893681 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3b73c449-3e01-4e39-b280-b5f7db24b852 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:06.894358 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3b73c449-3e01-4e39-b280-b5f7db24b852 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:06.900760 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3b73c449-3e01-4e39-b280-b5f7db24b852 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:06.901215 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3b73c449-3e01-4e39-b280-b5f7db24b852 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:06.901976 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3b73c449-3e01-4e39-b280-b5f7db24b852 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:06.902406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3b73c449-3e01-4e39-b280-b5f7db24b852 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:07.049630 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3b73c449-3e01-4e39-b280-b5f7db24b852 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:07.058556 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3b73c449-3e01-4e39-b280-b5f7db24b852 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1675 microversion: 2.1 time: 0.169035 Mar 08 19:21:07.059306 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 395/799] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:06 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:21:08.055207 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-8e88b14a-63bc-4d79-ab0b-a3728ebde4e6 req-809545d3-c2c9-4f2a-ac35-abde1a9c2281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e431bba0-7d48-4fff-ace4-d5ba4a32a2ea", "name": "network-vif-deleted", "tag": "202b6771-2b6b-4cec-a768-6c3521e9cd8f"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:08.064977 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-8e88b14a-63bc-4d79-ab0b-a3728ebde4e6 req-809545d3-c2c9-4f2a-ac35-abde1a9c2281 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:08.064977 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-8e88b14a-63bc-4d79-ab0b-a3728ebde4e6 req-809545d3-c2c9-4f2a-ac35-abde1a9c2281 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:08.076031 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-8e88b14a-63bc-4d79-ab0b-a3728ebde4e6 req-809545d3-c2c9-4f2a-ac35-abde1a9c2281 service nova] Creating event network-vif-deleted:202b6771-2b6b-4cec-a768-6c3521e9cd8f for instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea on hv-cinder-83009 Mar 08 19:21:08.077668 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9d842b4c-0fc7-4b47-b70b-8fa28279e4b9 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:08.078290 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9d842b4c-0fc7-4b47-b70b-8fa28279e4b9 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:08.082568 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-8e88b14a-63bc-4d79-ab0b-a3728ebde4e6 req-809545d3-c2c9-4f2a-ac35-abde1a9c2281 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031099 Mar 08 19:21:08.086488 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 405/800] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:21:08.087668 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d842b4c-0fc7-4b47-b70b-8fa28279e4b9 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:08.088157 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d842b4c-0fc7-4b47-b70b-8fa28279e4b9 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:08.088992 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d842b4c-0fc7-4b47-b70b-8fa28279e4b9 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:08.090011 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d842b4c-0fc7-4b47-b70b-8fa28279e4b9 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:08.166558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9d842b4c-0fc7-4b47-b70b-8fa28279e4b9 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:08.178016 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9d842b4c-0fc7-4b47-b70b-8fa28279e4b9 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 200 len: 1607 microversion: 2.1 time: 0.104313 Mar 08 19:21:08.178606 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 396/801] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:08 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 1607 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:21:09.197087 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:09.197706 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:09.204484 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:09.204984 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:09.205811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:09.206249 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:09.219287 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] HTTP exception thrown: Instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea could not be found. Mar 08 19:21:09.227037 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Returning 404 to user: Instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:21:09.227037 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5d2af954-4dbd-47df-9f84-6f52088fac52 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 404 len: 111 microversion: 2.1 time: 0.028850 Mar 08 19:21:09.227037 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 406/802] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:09 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:21:09.229965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-47e94fc6-8bb5-48eb-8441-99dfc9a5bd09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '.version_select at 0x7f438367d310>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:09.321404 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-47e94fc6-8bb5-48eb-8441-99dfc9a5bd09 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874096190" status: 202 len: 0 microversion: 2.1 time: 0.095233 Mar 08 19:21:09.322025 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 397/803] 10.222.0.75 () {58 vars in 1220 bytes} [Tue Mar 8 19:21:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1874096190 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:21:10.327113 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f19e53f6-4e88-4e55-8c43-734b9ee57117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'create', calling method: .version_select at 0x7f4383f65820>, body: {"keypair": {"name": "tempest-keypair-1714708076"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:10.341089 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-f19e53f6-4e88-4e55-8c43-734b9ee57117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for project 011362b6715747dba59bf9619c6bd65b. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:21:10.345346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-f19e53f6-4e88-4e55-8c43-734b9ee57117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for user 3b060e4c794d46009e926c8078045d8c and project 011362b6715747dba59bf9619c6bd65b. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:21:10.684953 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-f19e53f6-4e88-4e55-8c43-734b9ee57117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for project 011362b6715747dba59bf9619c6bd65b. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:21:10.688920 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-f19e53f6-4e88-4e55-8c43-734b9ee57117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for user 3b060e4c794d46009e926c8078045d8c and project 011362b6715747dba59bf9619c6bd65b. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:21:10.702727 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f19e53f6-4e88-4e55-8c43-734b9ee57117 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.379486 Mar 08 19:21:10.703405 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 407/804] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:21:10 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:21:13.032508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-283760335", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8a25d18-0969-475a-a1e7-ff064689da30"}], "security_groups": [{"name": "tempest-securitygroup--2108453165"}], "key_name": "tempest-keypair-1714708076", "user_data": "}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:13.139737 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] validate_networks() for [('c8a25d18-0969-475a-a1e7-ff064689da30', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:21:13.542259 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:21:13.542682 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:21:13.543250 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:21:13.543722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:21:13.544208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:21:13.553256 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:13.553704 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:13.554609 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:13.555097 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:13.572176 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for project 011362b6715747dba59bf9619c6bd65b. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:21:13.576380 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Getting quotas for user 3b060e4c794d46009e926c8078045d8c and project 011362b6715747dba59bf9619c6bd65b. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:21:13.589249 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:21:13.590978 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:21:13.739840 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e731cb40-8314-4910-bc28-c4b099d7310d tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712722 Mar 08 19:21:13.740522 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 398/805] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:21:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:21:13.750805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-769df4f7-8bf8-4889-9586-93f21548fade tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:13.751595 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-769df4f7-8bf8-4889-9586-93f21548fade tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:13.812324 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-769df4f7-8bf8-4889-9586-93f21548fade tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:13.820364 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-769df4f7-8bf8-4889-9586-93f21548fade tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1237 microversion: 2.1 time: 0.073569 Mar 08 19:21:13.820904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 408/806] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:13 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:14.846403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-81316380-22dc-4f5b-9d2c-ae37e42857db tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:14.847017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-81316380-22dc-4f5b-9d2c-ae37e42857db tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:14.853643 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-81316380-22dc-4f5b-9d2c-ae37e42857db tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:14.854129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-81316380-22dc-4f5b-9d2c-ae37e42857db tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:14.854871 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-81316380-22dc-4f5b-9d2c-ae37e42857db tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:14.855303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-81316380-22dc-4f5b-9d2c-ae37e42857db tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:14.914824 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-81316380-22dc-4f5b-9d2c-ae37e42857db tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:14.922126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-81316380-22dc-4f5b-9d2c-ae37e42857db tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1241 microversion: 2.1 time: 0.080286 Mar 08 19:21:14.922614 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 399/807] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:14 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:15.938943 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8d40b63b-a43a-4afa-a7b6-fc580603234e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:15.939547 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8d40b63b-a43a-4afa-a7b6-fc580603234e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:15.947180 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d40b63b-a43a-4afa-a7b6-fc580603234e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:15.947884 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d40b63b-a43a-4afa-a7b6-fc580603234e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:15.949225 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d40b63b-a43a-4afa-a7b6-fc580603234e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:15.949970 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8d40b63b-a43a-4afa-a7b6-fc580603234e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:16.014393 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8d40b63b-a43a-4afa-a7b6-fc580603234e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:16.023331 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8d40b63b-a43a-4afa-a7b6-fc580603234e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1307 microversion: 2.1 time: 0.088325 Mar 08 19:21:16.023944 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 409/808] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:15 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1307 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:17.040799 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-32167f64-4ddf-44af-8a14-394deee18f2e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:17.041423 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-32167f64-4ddf-44af-8a14-394deee18f2e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:17.048395 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-32167f64-4ddf-44af-8a14-394deee18f2e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:17.048862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-32167f64-4ddf-44af-8a14-394deee18f2e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:17.049645 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-32167f64-4ddf-44af-8a14-394deee18f2e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:17.050085 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-32167f64-4ddf-44af-8a14-394deee18f2e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:17.299772 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-32167f64-4ddf-44af-8a14-394deee18f2e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:17.308552 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-32167f64-4ddf-44af-8a14-394deee18f2e tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1363 microversion: 2.1 time: 0.271753 Mar 08 19:21:17.325989 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 400/809] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:17 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:17.525868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-c3805c67-e3be-41e2-bff3-f9233b149700 req-a6245912-4910-4cc1-ac57-becfd73d80ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acbc896-30e8-49e3-b3c7-53127e5d947e", "tag": "87c15cbd-fca3-451e-b547-9d99eaae8e90"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:17.537687 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-c3805c67-e3be-41e2-bff3-f9233b149700 req-a6245912-4910-4cc1-ac57-becfd73d80ef service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:17.537687 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-c3805c67-e3be-41e2-bff3-f9233b149700 req-a6245912-4910-4cc1-ac57-becfd73d80ef service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:17.551975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-c3805c67-e3be-41e2-bff3-f9233b149700 req-a6245912-4910-4cc1-ac57-becfd73d80ef service nova] Creating event network-changed:87c15cbd-fca3-451e-b547-9d99eaae8e90 for instance 0acbc896-30e8-49e3-b3c7-53127e5d947e on hv-cinder-83009 Mar 08 19:21:17.557117 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-c3805c67-e3be-41e2-bff3-f9233b149700 req-a6245912-4910-4cc1-ac57-becfd73d80ef service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035388 Mar 08 19:21:17.558149 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 410/810] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:21:18.326833 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-50f9cb8e-9abb-4f25-934d-54af4b24373a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:18.327380 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-50f9cb8e-9abb-4f25-934d-54af4b24373a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:18.337915 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-50f9cb8e-9abb-4f25-934d-54af4b24373a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:18.338507 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-50f9cb8e-9abb-4f25-934d-54af4b24373a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:18.339658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-50f9cb8e-9abb-4f25-934d-54af4b24373a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:18.340225 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-50f9cb8e-9abb-4f25-934d-54af4b24373a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:18.489913 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-50f9cb8e-9abb-4f25-934d-54af4b24373a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:18.502166 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-50f9cb8e-9abb-4f25-934d-54af4b24373a tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1363 microversion: 2.1 time: 0.179275 Mar 08 19:21:18.505397 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 401/811] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:18 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:19.523061 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c05e4384-c771-46dc-acc4-3bbeb6ae3e5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:19.523788 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c05e4384-c771-46dc-acc4-3bbeb6ae3e5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:19.530299 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c05e4384-c771-46dc-acc4-3bbeb6ae3e5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:19.530769 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c05e4384-c771-46dc-acc4-3bbeb6ae3e5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:19.531527 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c05e4384-c771-46dc-acc4-3bbeb6ae3e5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:19.533093 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c05e4384-c771-46dc-acc4-3bbeb6ae3e5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:19.667313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c05e4384-c771-46dc-acc4-3bbeb6ae3e5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:19.677553 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c05e4384-c771-46dc-acc4-3bbeb6ae3e5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1363 microversion: 2.1 time: 0.158913 Mar 08 19:21:19.678395 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 411/812] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:19 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:20.695292 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1221d5de-324e-4392-bbbd-6e1c8e9526c4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:20.695938 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1221d5de-324e-4392-bbbd-6e1c8e9526c4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:20.702271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1221d5de-324e-4392-bbbd-6e1c8e9526c4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:20.702732 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1221d5de-324e-4392-bbbd-6e1c8e9526c4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:20.703495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1221d5de-324e-4392-bbbd-6e1c8e9526c4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:20.704539 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1221d5de-324e-4392-bbbd-6e1c8e9526c4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:20.842090 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1221d5de-324e-4392-bbbd-6e1c8e9526c4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:20.849454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1221d5de-324e-4392-bbbd-6e1c8e9526c4 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1363 microversion: 2.1 time: 0.158078 Mar 08 19:21:20.850015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 402/813] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:20 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:21.868438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ae09a108-4d12-4a83-ada2-60a34a0ad6a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:21.869172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ae09a108-4d12-4a83-ada2-60a34a0ad6a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:21.878353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae09a108-4d12-4a83-ada2-60a34a0ad6a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:21.878806 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae09a108-4d12-4a83-ada2-60a34a0ad6a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:21.879590 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae09a108-4d12-4a83-ada2-60a34a0ad6a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:21.880054 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae09a108-4d12-4a83-ada2-60a34a0ad6a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:22.030515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ae09a108-4d12-4a83-ada2-60a34a0ad6a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:22.038710 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ae09a108-4d12-4a83-ada2-60a34a0ad6a8 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1363 microversion: 2.1 time: 0.175195 Mar 08 19:21:22.039298 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 412/814] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:21 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:21:23.058075 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d7bed6d1-4593-45c5-9625-be5f6e915835 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:23.058843 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d7bed6d1-4593-45c5-9625-be5f6e915835 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:23.067463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d7bed6d1-4593-45c5-9625-be5f6e915835 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:23.068303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d7bed6d1-4593-45c5-9625-be5f6e915835 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:23.069621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d7bed6d1-4593-45c5-9625-be5f6e915835 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:23.070383 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d7bed6d1-4593-45c5-9625-be5f6e915835 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:23.225277 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d7bed6d1-4593-45c5-9625-be5f6e915835 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:23.232753 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d7bed6d1-4593-45c5-9625-be5f6e915835 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1363 microversion: 2.1 time: 0.180262 Mar 08 19:21:23.233329 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 403/815] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:23 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:24.251903 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-70cb8856-20b9-4f80-980b-77a7cc179ee3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:24.252590 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-70cb8856-20b9-4f80-980b-77a7cc179ee3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:24.258787 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-70cb8856-20b9-4f80-980b-77a7cc179ee3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:24.259251 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-70cb8856-20b9-4f80-980b-77a7cc179ee3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:24.260072 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-70cb8856-20b9-4f80-980b-77a7cc179ee3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:24.260503 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-70cb8856-20b9-4f80-980b-77a7cc179ee3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:24.404631 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-70cb8856-20b9-4f80-980b-77a7cc179ee3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:24.412882 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-70cb8856-20b9-4f80-980b-77a7cc179ee3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1363 microversion: 2.1 time: 0.166045 Mar 08 19:21:24.413460 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 413/816] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:24 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:24.427523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-fc92913d-0b47-458b-b51e-81a8a0cfec3f req-76d22092-1e36-4abd-ad49-533856daa799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acbc896-30e8-49e3-b3c7-53127e5d947e", "name": "network-vif-plugged", "status": "completed", "tag": "87c15cbd-fca3-451e-b547-9d99eaae8e90"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:24.435864 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-fc92913d-0b47-458b-b51e-81a8a0cfec3f req-76d22092-1e36-4abd-ad49-533856daa799 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:24.436350 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-fc92913d-0b47-458b-b51e-81a8a0cfec3f req-76d22092-1e36-4abd-ad49-533856daa799 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:24.447617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-fc92913d-0b47-458b-b51e-81a8a0cfec3f req-76d22092-1e36-4abd-ad49-533856daa799 service nova] Creating event network-vif-plugged:87c15cbd-fca3-451e-b547-9d99eaae8e90 for instance 0acbc896-30e8-49e3-b3c7-53127e5d947e on hv-cinder-83009 Mar 08 19:21:24.452936 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-fc92913d-0b47-458b-b51e-81a8a0cfec3f req-76d22092-1e36-4abd-ad49-533856daa799 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029005 Mar 08 19:21:24.453610 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 404/817] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:21:25.430227 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4fc3d865-8354-428c-be41-6b0518c44758 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:25.430866 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4fc3d865-8354-428c-be41-6b0518c44758 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:25.437292 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4fc3d865-8354-428c-be41-6b0518c44758 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:25.437734 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4fc3d865-8354-428c-be41-6b0518c44758 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:25.439073 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4fc3d865-8354-428c-be41-6b0518c44758 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:25.439508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4fc3d865-8354-428c-be41-6b0518c44758 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:25.598137 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4fc3d865-8354-428c-be41-6b0518c44758 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:25.607726 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4fc3d865-8354-428c-be41-6b0518c44758 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1363 microversion: 2.1 time: 0.181765 Mar 08 19:21:25.608501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 414/818] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:25 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:26.627127 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-dafff413-cfb2-441f-9a47-e9f6c5d53f33 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:26.627830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-dafff413-cfb2-441f-9a47-e9f6c5d53f33 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:26.634273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dafff413-cfb2-441f-9a47-e9f6c5d53f33 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:26.634725 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dafff413-cfb2-441f-9a47-e9f6c5d53f33 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:26.635487 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dafff413-cfb2-441f-9a47-e9f6c5d53f33 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:26.635939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dafff413-cfb2-441f-9a47-e9f6c5d53f33 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:26.768191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-dafff413-cfb2-441f-9a47-e9f6c5d53f33 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:26.775506 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-dafff413-cfb2-441f-9a47-e9f6c5d53f33 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1549 microversion: 2.1 time: 0.153711 Mar 08 19:21:26.776101 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 405/819] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:26 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:26.792022 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-729a3815-eb80-4c07-80df-22ea66121a42 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:26.792758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-729a3815-eb80-4c07-80df-22ea66121a42 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:26.799554 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-729a3815-eb80-4c07-80df-22ea66121a42 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:26.800029 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-729a3815-eb80-4c07-80df-22ea66121a42 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:26.800796 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-729a3815-eb80-4c07-80df-22ea66121a42 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:26.801234 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-729a3815-eb80-4c07-80df-22ea66121a42 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:26.886421 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-729a3815-eb80-4c07-80df-22ea66121a42 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098176 Mar 08 19:21:26.886944 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 415/820] 10.222.0.75 () {58 vars in 1274 bytes} [Tue Mar 8 19:21:26 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:21:28.478461 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-e247d3dd-e327-4dd5-af49-c67494bae490 req-3edbacfa-7f3a-4c48-aa63-71d0ed44557c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0acbc896-30e8-49e3-b3c7-53127e5d947e", "tag": "87c15cbd-fca3-451e-b547-9d99eaae8e90"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:28.487641 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-e247d3dd-e327-4dd5-af49-c67494bae490 req-3edbacfa-7f3a-4c48-aa63-71d0ed44557c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:28.488477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-e247d3dd-e327-4dd5-af49-c67494bae490 req-3edbacfa-7f3a-4c48-aa63-71d0ed44557c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:28.499705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-e247d3dd-e327-4dd5-af49-c67494bae490 req-3edbacfa-7f3a-4c48-aa63-71d0ed44557c service nova] Creating event network-changed:87c15cbd-fca3-451e-b547-9d99eaae8e90 for instance 0acbc896-30e8-49e3-b3c7-53127e5d947e on hv-cinder-83009 Mar 08 19:21:28.505423 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-e247d3dd-e327-4dd5-af49-c67494bae490 req-3edbacfa-7f3a-4c48-aa63-71d0ed44557c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030521 Mar 08 19:21:28.506022 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 406/821] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:21:32.645914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-36567e92-0890-40a3-a56a-e12cf2bd67fe tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:32.646860 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-36567e92-0890-40a3-a56a-e12cf2bd67fe tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:32.653979 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-36567e92-0890-40a3-a56a-e12cf2bd67fe tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:32.654461 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-36567e92-0890-40a3-a56a-e12cf2bd67fe tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:32.655828 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-36567e92-0890-40a3-a56a-e12cf2bd67fe tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:32.657172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-36567e92-0890-40a3-a56a-e12cf2bd67fe tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:32.913586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-36567e92-0890-40a3-a56a-e12cf2bd67fe tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "POST /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/action" status: 202 len: 0 microversion: 2.1 time: 0.272139 Mar 08 19:21:32.914341 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 416/822] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:21:32 2022] POST /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:21:32.924807 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c66cd2f8-b9bf-4454-959d-e9522bac19b1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:32.926207 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c66cd2f8-b9bf-4454-959d-e9522bac19b1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:32.932623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c66cd2f8-b9bf-4454-959d-e9522bac19b1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:32.933110 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c66cd2f8-b9bf-4454-959d-e9522bac19b1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:32.933896 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c66cd2f8-b9bf-4454-959d-e9522bac19b1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:32.934355 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c66cd2f8-b9bf-4454-959d-e9522bac19b1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:33.127671 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c66cd2f8-b9bf-4454-959d-e9522bac19b1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:33.136657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c66cd2f8-b9bf-4454-959d-e9522bac19b1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1750 microversion: 2.1 time: 0.217788 Mar 08 19:21:33.137245 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 407/823] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:32 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1750 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:34.156700 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fb7df667-c32e-4ac0-b7aa-47e655406d9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:34.157482 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fb7df667-c32e-4ac0-b7aa-47e655406d9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:34.163642 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb7df667-c32e-4ac0-b7aa-47e655406d9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:34.164118 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb7df667-c32e-4ac0-b7aa-47e655406d9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:34.164874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb7df667-c32e-4ac0-b7aa-47e655406d9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:34.165303 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb7df667-c32e-4ac0-b7aa-47e655406d9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:34.311798 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fb7df667-c32e-4ac0-b7aa-47e655406d9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:34.320369 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fb7df667-c32e-4ac0-b7aa-47e655406d9f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.168344 Mar 08 19:21:34.325527 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 417/824] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:34 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:21:35.338511 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-77f4aa9d-e4f8-45d1-bacf-e10b93717517 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:35.339117 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-77f4aa9d-e4f8-45d1-bacf-e10b93717517 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:35.346051 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-77f4aa9d-e4f8-45d1-bacf-e10b93717517 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:35.349679 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-77f4aa9d-e4f8-45d1-bacf-e10b93717517 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:35.349679 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-77f4aa9d-e4f8-45d1-bacf-e10b93717517 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:35.349679 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-77f4aa9d-e4f8-45d1-bacf-e10b93717517 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:35.494522 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-77f4aa9d-e4f8-45d1-bacf-e10b93717517 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:35.503396 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-77f4aa9d-e4f8-45d1-bacf-e10b93717517 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.168900 Mar 08 19:21:35.503995 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 408/825] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:35 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:36.521079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-59e51ecc-5d26-4cfd-b9b8-1a32c36d8c1f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:36.521690 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-59e51ecc-5d26-4cfd-b9b8-1a32c36d8c1f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:36.528032 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59e51ecc-5d26-4cfd-b9b8-1a32c36d8c1f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:36.528868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59e51ecc-5d26-4cfd-b9b8-1a32c36d8c1f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:36.529253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59e51ecc-5d26-4cfd-b9b8-1a32c36d8c1f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:36.529686 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-59e51ecc-5d26-4cfd-b9b8-1a32c36d8c1f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:36.677987 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-59e51ecc-5d26-4cfd-b9b8-1a32c36d8c1f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:36.686073 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-59e51ecc-5d26-4cfd-b9b8-1a32c36d8c1f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.169415 Mar 08 19:21:36.686633 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 418/826] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:36 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:37.702917 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a3e094e0-d786-4b1c-9c5d-f674f2e27e30 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:37.703536 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a3e094e0-d786-4b1c-9c5d-f674f2e27e30 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:37.710790 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a3e094e0-d786-4b1c-9c5d-f674f2e27e30 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:37.711243 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a3e094e0-d786-4b1c-9c5d-f674f2e27e30 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:37.712264 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a3e094e0-d786-4b1c-9c5d-f674f2e27e30 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:37.712722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a3e094e0-d786-4b1c-9c5d-f674f2e27e30 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:37.891468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a3e094e0-d786-4b1c-9c5d-f674f2e27e30 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:37.900566 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a3e094e0-d786-4b1c-9c5d-f674f2e27e30 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.201530 Mar 08 19:21:37.901145 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 409/827] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:37 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:38.920989 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3c75e990-6097-461e-aaf9-5c6470bffe6d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:38.922431 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-3c75e990-6097-461e-aaf9-5c6470bffe6d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:38.929690 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3c75e990-6097-461e-aaf9-5c6470bffe6d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:38.930146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3c75e990-6097-461e-aaf9-5c6470bffe6d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:38.931005 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3c75e990-6097-461e-aaf9-5c6470bffe6d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:38.931636 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-3c75e990-6097-461e-aaf9-5c6470bffe6d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:39.096432 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-3c75e990-6097-461e-aaf9-5c6470bffe6d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:39.104399 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3c75e990-6097-461e-aaf9-5c6470bffe6d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.190313 Mar 08 19:21:39.104967 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 419/828] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:38 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:40.122616 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1fdd0326-a299-4b2b-adcd-1027527d473a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:40.123224 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1fdd0326-a299-4b2b-adcd-1027527d473a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:40.129827 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1fdd0326-a299-4b2b-adcd-1027527d473a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:40.130271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1fdd0326-a299-4b2b-adcd-1027527d473a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:40.131034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1fdd0326-a299-4b2b-adcd-1027527d473a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:40.131733 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1fdd0326-a299-4b2b-adcd-1027527d473a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:40.282393 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1fdd0326-a299-4b2b-adcd-1027527d473a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:40.290496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1fdd0326-a299-4b2b-adcd-1027527d473a tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.171819 Mar 08 19:21:40.291069 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 410/829] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:40 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:41.307661 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4a68b7da-52b2-4ad8-aa27-2b128e3daf13 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:41.308242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4a68b7da-52b2-4ad8-aa27-2b128e3daf13 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:41.315132 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4a68b7da-52b2-4ad8-aa27-2b128e3daf13 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:41.315574 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4a68b7da-52b2-4ad8-aa27-2b128e3daf13 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:41.316392 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4a68b7da-52b2-4ad8-aa27-2b128e3daf13 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:41.316826 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4a68b7da-52b2-4ad8-aa27-2b128e3daf13 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:41.471449 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4a68b7da-52b2-4ad8-aa27-2b128e3daf13 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:41.479536 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4a68b7da-52b2-4ad8-aa27-2b128e3daf13 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.175819 Mar 08 19:21:41.480143 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 420/830] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:41 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:42.497167 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7c86fc33-961b-4697-aeea-9810b56baccf tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:42.497766 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7c86fc33-961b-4697-aeea-9810b56baccf tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:42.505030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7c86fc33-961b-4697-aeea-9810b56baccf tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:42.505561 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7c86fc33-961b-4697-aeea-9810b56baccf tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:42.506686 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7c86fc33-961b-4697-aeea-9810b56baccf tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:42.507154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7c86fc33-961b-4697-aeea-9810b56baccf tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:42.657140 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7c86fc33-961b-4697-aeea-9810b56baccf tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:42.664957 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7c86fc33-961b-4697-aeea-9810b56baccf tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.171686 Mar 08 19:21:42.665512 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 411/831] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:42 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:43.062285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a47362ea-23c2-4f50-bf81-d115a997106f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:43.062818 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a47362ea-23c2-4f50-bf81-d115a997106f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:43.070031 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a47362ea-23c2-4f50-bf81-d115a997106f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:43.070477 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a47362ea-23c2-4f50-bf81-d115a997106f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:43.071289 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a47362ea-23c2-4f50-bf81-d115a997106f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:43.071721 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a47362ea-23c2-4f50-bf81-d115a997106f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:43.096181 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a47362ea-23c2-4f50-bf81-d115a997106f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/ips" status: 200 len: 151 microversion: 2.20 time: 0.037644 Mar 08 19:21:43.096799 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 421/832] 10.222.0.75 () {60 vars in 1288 bytes} [Tue Mar 8 19:21:43 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:21:43.150062 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-057e109e-7565-49dc-9f0c-23f5a6a6d427 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:43.150563 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-057e109e-7565-49dc-9f0c-23f5a6a6d427 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:43.156500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-057e109e-7565-49dc-9f0c-23f5a6a6d427 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:43.157030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-057e109e-7565-49dc-9f0c-23f5a6a6d427 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:43.158320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-057e109e-7565-49dc-9f0c-23f5a6a6d427 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:43.158756 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-057e109e-7565-49dc-9f0c-23f5a6a6d427 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:43.183411 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-057e109e-7565-49dc-9f0c-23f5a6a6d427 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/ips" status: 200 len: 149 microversion: 2.1 time: 0.037014 Mar 08 19:21:43.184227 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 412/833] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:21:43 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:21:43.682589 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f9e27b8f-d23d-442b-b975-ce25b3410d3d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:43.683345 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f9e27b8f-d23d-442b-b975-ce25b3410d3d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:43.689577 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f9e27b8f-d23d-442b-b975-ce25b3410d3d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:43.689960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f9e27b8f-d23d-442b-b975-ce25b3410d3d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:43.690731 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f9e27b8f-d23d-442b-b975-ce25b3410d3d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:43.691232 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f9e27b8f-d23d-442b-b975-ce25b3410d3d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:43.858392 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f9e27b8f-d23d-442b-b975-ce25b3410d3d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:43.866302 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f9e27b8f-d23d-442b-b975-ce25b3410d3d tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1755 microversion: 2.1 time: 0.187599 Mar 08 19:21:43.866870 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 422/834] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:43 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1755 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:44.882761 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a1c34810-4380-4a78-9435-c384f497bf21 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:44.883396 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a1c34810-4380-4a78-9435-c384f497bf21 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:44.889673 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a1c34810-4380-4a78-9435-c384f497bf21 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:44.896495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a1c34810-4380-4a78-9435-c384f497bf21 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:44.896495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a1c34810-4380-4a78-9435-c384f497bf21 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:44.896495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a1c34810-4380-4a78-9435-c384f497bf21 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:45.050434 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a1c34810-4380-4a78-9435-c384f497bf21 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:45.058476 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a1c34810-4380-4a78-9435-c384f497bf21 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1758 microversion: 2.1 time: 0.179748 Mar 08 19:21:45.059048 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 413/835] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:44 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:45.925395 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0157b8a9-8f52-449b-a380-aeb0e3172a74 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e82c26e4-e4fe-4e00-81f9-1cdf55c89cf3"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:45.926560 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0157b8a9-8f52-449b-a380-aeb0e3172a74 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:45.932948 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0157b8a9-8f52-449b-a380-aeb0e3172a74 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:45.933391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0157b8a9-8f52-449b-a380-aeb0e3172a74 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:45.934163 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0157b8a9-8f52-449b-a380-aeb0e3172a74 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:45.934600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0157b8a9-8f52-449b-a380-aeb0e3172a74 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:46.267031 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-49ac5cf7-6dd8-49ea-9e8f-4afa4c145690 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:46.267576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-49ac5cf7-6dd8-49ea-9e8f-4afa4c145690 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:46.274239 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49ac5cf7-6dd8-49ea-9e8f-4afa4c145690 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:46.275986 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49ac5cf7-6dd8-49ea-9e8f-4afa4c145690 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:46.275986 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49ac5cf7-6dd8-49ea-9e8f-4afa4c145690 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:46.275986 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49ac5cf7-6dd8-49ea-9e8f-4afa4c145690 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:46.301095 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-49ac5cf7-6dd8-49ea-9e8f-4afa4c145690 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lazy-loading 'flavor' on Instance uuid 2fb629d0-2eab-412c-8995-f16c1538c828 {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:21:46.666382 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0157b8a9-8f52-449b-a380-aeb0e3172a74 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744701 Mar 08 19:21:46.670450 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 423/836] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:21:45 2022] POST /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:21:46.922025 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-49ac5cf7-6dd8-49ea-9e8f-4afa4c145690 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/action" status: 202 len: 0 microversion: 2.20 time: 0.658781 Mar 08 19:21:46.925678 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 414/837] 10.222.0.75 () {62 vars in 1318 bytes} [Tue Mar 8 19:21:46 2022] POST /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 08 19:21:46.935368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:46.936133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:46.945611 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:46.946102 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:46.947156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:46.947635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:47.102076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:47.110548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:47.112772 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:47.117071 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5e2f9e00-c99f-441c-9cfa-fc0d89145bec tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.188463 Mar 08 19:21:47.117660 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 424/838] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:46 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:21:48.139328 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:48.139950 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:48.147362 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:48.148645 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:48.151328 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:48.151808 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:48.291003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:48.300022 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:48.301545 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:48.302703 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2e86a397-f3c6-4162-830f-664b2c6c675a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.168247 Mar 08 19:21:48.303256 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 415/839] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:48 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:49.321168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:49.321756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:49.328124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:49.328575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:49.329349 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:49.329785 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:49.463942 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:49.472558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:49.474099 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:49.475260 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-debfe3c6-7a7e-4bcd-bb56-dacb94b82026 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.158175 Mar 08 19:21:49.475809 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 425/840] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:49 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:50.493931 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:50.494549 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:50.500856 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:50.501868 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:50.502637 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:50.503079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:50.637863 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:50.646279 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:50.647769 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:50.648944 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-669168c8-b7cc-483a-8865-52f30f577e8f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.158963 Mar 08 19:21:50.649501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 416/841] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:50 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:51.667846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:51.668558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:51.676805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:51.677352 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:51.678191 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:51.678751 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:51.840638 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:51.850252 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:51.852009 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:51.853857 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-37df0591-db47-45ad-9ff7-869045bca57f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.189979 Mar 08 19:21:51.854832 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 426/842] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:51 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:52.873153 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:52.873818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:52.881426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:52.881882 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:52.885794 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:52.885794 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:53.027705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:53.036414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:53.037942 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:53.039111 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0234277c-a96c-4af2-a783-8439e3280d25 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.169875 Mar 08 19:21:53.039671 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 417/843] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:52 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:54.058900 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:54.059516 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:54.069338 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:54.069775 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:54.070715 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:54.071151 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:54.171650 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e82c26e4-e4fe-4e00-81f9-1cdf55c89cf3"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:21:54.173984 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:54.180142 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:54.180600 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:54.181408 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:54.181819 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:54.238820 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:54.246719 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:54.248444 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:54.249584 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6ae58a91-6631-428b-83b6-7cb7cc8e0190 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.195066 Mar 08 19:21:54.250133 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 427/844] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:54 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:54.265172 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Invalid volume: volume e82c26e4-e4fe-4e00-81f9-1cdf55c89cf3 is already attached to instances: 9c138706-751b-40a6-9cd3-9200e0dc36fd Mar 08 19:21:54.265794 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 400 to user: Invalid volume: volume e82c26e4-e4fe-4e00-81f9-1cdf55c89cf3 is already attached to instances: 9c138706-751b-40a6-9cd3-9200e0dc36fd {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:21:54.267899 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c4b2784b-e382-417c-a8b3-ad409a35b1fa tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099908 Mar 08 19:21:54.268496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 418/845] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:21:54 2022] POST /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Mar 08 19:21:54.328421 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8ef29665-d410-490e-98a5-4bfbd3a6a35d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:54.328944 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8ef29665-d410-490e-98a5-4bfbd3a6a35d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:54.334784 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8ef29665-d410-490e-98a5-4bfbd3a6a35d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:54.335230 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8ef29665-d410-490e-98a5-4bfbd3a6a35d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:54.336037 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8ef29665-d410-490e-98a5-4bfbd3a6a35d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:54.336469 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8ef29665-d410-490e-98a5-4bfbd3a6a35d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:54.419755 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-8ef29665-d410-490e-98a5-4bfbd3a6a35d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lazy-loading 'services' on Instance uuid 9c138706-751b-40a6-9cd3-9200e0dc36fd {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:21:54.673587 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8ef29665-d410-490e-98a5-4bfbd3a6a35d tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments/e82c26e4-e4fe-4e00-81f9-1cdf55c89cf3" status: 202 len: 0 microversion: 2.1 time: 0.348176 Mar 08 19:21:54.674187 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 428/846] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:21:54 2022] DELETE /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments/e82c26e4-e4fe-4e00-81f9-1cdf55c89cf3 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:21:54.682513 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-81d368d9-057e-40c2-b263-daa953f2ec0a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:54.683445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-81d368d9-057e-40c2-b263-daa953f2ec0a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:54.690226 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-81d368d9-057e-40c2-b263-daa953f2ec0a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:54.690804 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-81d368d9-057e-40c2-b263-daa953f2ec0a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:54.691582 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-81d368d9-057e-40c2-b263-daa953f2ec0a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:54.692115 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-81d368d9-057e-40c2-b263-daa953f2ec0a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:54.723668 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-81d368d9-057e-40c2-b263-daa953f2ec0a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Mar 08 19:21:54.724240 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 419/847] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:21:54 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:21:55.270543 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:55.271477 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:55.277373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:55.277818 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:55.278576 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:55.279009 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:55.415357 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:55.424103 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:55.425616 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:55.426763 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5113eaa4-e165-45ef-950c-3c439175125d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.161788 Mar 08 19:21:55.427314 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 429/848] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:55 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:55.734656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-80328134-d9d2-434b-a239-d115ffbed439 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:55.736255 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-80328134-d9d2-434b-a239-d115ffbed439 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:55.742568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-80328134-d9d2-434b-a239-d115ffbed439 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:55.743015 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-80328134-d9d2-434b-a239-d115ffbed439 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:55.743776 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-80328134-d9d2-434b-a239-d115ffbed439 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:55.744238 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-80328134-d9d2-434b-a239-d115ffbed439 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:55.774330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-80328134-d9d2-434b-a239-d115ffbed439 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043522 Mar 08 19:21:55.774894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 420/849] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:21:55 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:21:56.445967 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:56.446578 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:56.452849 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:56.453307 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:56.454694 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:56.455229 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:56.591440 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:56.600219 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:56.601743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:56.603091 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-694b7c5d-c9bd-4651-a0d7-d650ba5debb5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.161053 Mar 08 19:21:56.603668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 430/850] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:56 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:56.786657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c84ff82c-18e2-41be-bfde-6e1e8e9dd4cf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:56.787476 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c84ff82c-18e2-41be-bfde-6e1e8e9dd4cf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:56.793786 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c84ff82c-18e2-41be-bfde-6e1e8e9dd4cf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:56.794231 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c84ff82c-18e2-41be-bfde-6e1e8e9dd4cf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:56.794992 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c84ff82c-18e2-41be-bfde-6e1e8e9dd4cf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:56.795423 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c84ff82c-18e2-41be-bfde-6e1e8e9dd4cf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:56.824551 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c84ff82c-18e2-41be-bfde-6e1e8e9dd4cf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042550 Mar 08 19:21:56.825106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 421/851] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:21:56 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:21:56.882831 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e05154f7-508c-4a2b-a948-fc473d470f80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:56.883326 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e05154f7-508c-4a2b-a948-fc473d470f80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:56.889344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e05154f7-508c-4a2b-a948-fc473d470f80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:56.889797 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e05154f7-508c-4a2b-a948-fc473d470f80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:56.890601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e05154f7-508c-4a2b-a948-fc473d470f80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:56.891035 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e05154f7-508c-4a2b-a948-fc473d470f80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:56.916775 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e05154f7-508c-4a2b-a948-fc473d470f80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:21:57.210621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e05154f7-508c-4a2b-a948-fc473d470f80 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 204 len: 0 microversion: 2.1 time: 0.331567 Mar 08 19:21:57.211237 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 431/852] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:21:56 2022] DELETE /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:21:57.219564 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f6c9a9fb-b9d1-461b-831e-ef8d35ec7c7e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:57.220205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f6c9a9fb-b9d1-461b-831e-ef8d35ec7c7e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:57.226412 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6c9a9fb-b9d1-461b-831e-ef8d35ec7c7e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:57.226861 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6c9a9fb-b9d1-461b-831e-ef8d35ec7c7e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:57.227671 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6c9a9fb-b9d1-461b-831e-ef8d35ec7c7e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:57.228121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f6c9a9fb-b9d1-461b-831e-ef8d35ec7c7e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:57.371244 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f6c9a9fb-b9d1-461b-831e-ef8d35ec7c7e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:57.379580 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f6c9a9fb-b9d1-461b-831e-ef8d35ec7c7e tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1681 microversion: 2.1 time: 0.163944 Mar 08 19:21:57.380190 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 422/853] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:57 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:21:57.623178 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:57.623797 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:57.630444 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:57.630929 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:57.631985 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:57.632423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:57.797544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:57.805613 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:57.807135 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:57.808330 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a38f5a1f-775e-40f3-837b-578f58955e6b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.189487 Mar 08 19:21:57.808885 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 432/854] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:57 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:58.397644 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4908955b-0721-4db0-8192-b78d79d994d9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:58.398255 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4908955b-0721-4db0-8192-b78d79d994d9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:58.404619 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4908955b-0721-4db0-8192-b78d79d994d9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:58.405071 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4908955b-0721-4db0-8192-b78d79d994d9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:58.405830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4908955b-0721-4db0-8192-b78d79d994d9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:58.406265 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4908955b-0721-4db0-8192-b78d79d994d9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:58.541445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4908955b-0721-4db0-8192-b78d79d994d9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:58.548907 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4908955b-0721-4db0-8192-b78d79d994d9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1681 microversion: 2.1 time: 0.155313 Mar 08 19:21:58.549463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 423/855] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:58 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:21:58.826657 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:58.827194 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:58.834125 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:58.834579 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:58.835361 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:58.835803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:58.971874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:58.982628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:58.984285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:58.986236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5a9baeb2-accd-420e-8e9e-fb448bb4272d tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.163434 Mar 08 19:21:58.986797 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 433/856] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:58 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:21:59.565181 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3cb58856-b3b7-4204-98c8-a22be0b548c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:21:59.565758 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3cb58856-b3b7-4204-98c8-a22be0b548c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:21:59.571909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3cb58856-b3b7-4204-98c8-a22be0b548c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:59.572375 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3cb58856-b3b7-4204-98c8-a22be0b548c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:59.573188 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3cb58856-b3b7-4204-98c8-a22be0b548c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:21:59.573579 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3cb58856-b3b7-4204-98c8-a22be0b548c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:21:59.798235 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3cb58856-b3b7-4204-98c8-a22be0b548c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:21:59.805881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3cb58856-b3b7-4204-98c8-a22be0b548c3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1681 microversion: 2.1 time: 0.244659 Mar 08 19:21:59.806606 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 424/857] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:21:59 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:22:00.005520 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:00.006508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:00.012771 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:00.013226 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:00.013993 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:00.014430 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:00.299699 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:00.301881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-e7430e27-d5ec-4fbe-8677-32b7a5c4585d req-3b5fafb5-0849-4ee2-8370-91adc69f7141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c138706-751b-40a6-9cd3-9200e0dc36fd", "name": "network-vif-deleted", "tag": "5734a3a9-cc72-4bae-8317-bbdde03ac4ac"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:00.307612 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:00.310033 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:00.311576 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4ce254ae-970c-4f3d-a0e9-d0799b9a7a3c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.309850 Mar 08 19:22:00.312253 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-e7430e27-d5ec-4fbe-8677-32b7a5c4585d req-3b5fafb5-0849-4ee2-8370-91adc69f7141 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:00.312666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 434/858] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:21:59 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:00.320912 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-e7430e27-d5ec-4fbe-8677-32b7a5c4585d req-3b5fafb5-0849-4ee2-8370-91adc69f7141 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:00.336179 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-e7430e27-d5ec-4fbe-8677-32b7a5c4585d req-3b5fafb5-0849-4ee2-8370-91adc69f7141 service nova] Creating event network-vif-deleted:5734a3a9-cc72-4bae-8317-bbdde03ac4ac for instance 9c138706-751b-40a6-9cd3-9200e0dc36fd on hv-cinder-83009 Mar 08 19:22:00.341541 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-e7430e27-d5ec-4fbe-8677-32b7a5c4585d req-3b5fafb5-0849-4ee2-8370-91adc69f7141 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057249 Mar 08 19:22:00.342374 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 425/859] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:00.823883 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:00.824443 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:00.830963 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:00.831413 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:00.832209 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:00.832646 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:00.865513 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:00.866101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:00.866660 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lazy-loading 'fault' on Instance uuid 9c138706-751b-40a6-9cd3-9200e0dc36fd {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:22:00.913142 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:00.923334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-195adbf3-ba01-41b3-9a73-0bc1f5e0a43a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 200 len: 1331 microversion: 2.1 time: 0.100799 Mar 08 19:22:00.924630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 435/860] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:00 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:01.331600 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:01.332335 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:01.338508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:01.338898 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:01.339689 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:01.340159 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:01.483827 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:01.492873 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:01.494400 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:01.495540 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fac05421-e2b7-4fda-97df-c937c9ef01e6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.169536 Mar 08 19:22:01.496110 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 426/861] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:01 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:01.940905 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:01.941643 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:01.948225 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:01.948684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:01.949465 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:01.949904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:01.963299 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 9c138706-751b-40a6-9cd3-9200e0dc36fd could not be found. Mar 08 19:22:01.963887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 9c138706-751b-40a6-9cd3-9200e0dc36fd could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:22:01.964726 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ab3eaeef-63c4-48ab-a538-2c2b7d2fda72 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 404 len: 111 microversion: 2.1 time: 0.027783 Mar 08 19:22:01.965255 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 436/862] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:01 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:22:01.974062 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-faaa36e7-4d23-4dd4-92c2-4ce54c6e1d10 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '.version_select at 0x7f43835dff70>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:02.022676 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-faaa36e7-4d23-4dd4-92c2-4ce54c6e1d10 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-993428842" status: 202 len: 0 microversion: 2.1 time: 0.052325 Mar 08 19:22:02.023233 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 427/863] 10.222.0.75 () {58 vars in 1217 bytes} [Tue Mar 8 19:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-993428842 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:22:02.514170 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:02.514873 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:02.521701 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:02.522347 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:02.523805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:02.523805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:02.687813 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:02.697595 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:02.699517 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:02.701173 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a78edf3e-498f-4c75-98d5-45c83a004d67 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.190970 Mar 08 19:22:02.702199 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 437/864] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:02 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:02.910035 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bf14e477-0cf4-4284-865e-40b211253e78 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: .version_select at 0x7f43835c8940>, body: {"keypair": {"name": "tempest-keypair-868129316"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:02.927062 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-bf14e477-0cf4-4284-865e-40b211253e78 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:22:02.931140 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-bf14e477-0cf4-4284-865e-40b211253e78 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:22:03.249302 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-bf14e477-0cf4-4284-865e-40b211253e78 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:22:03.253726 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-bf14e477-0cf4-4284-865e-40b211253e78 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'key_pairs'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:22:03.267143 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bf14e477-0cf4-4284-865e-40b211253e78 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.362366 Mar 08 19:22:03.267857 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 428/865] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:22:02 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:03.723453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:03.724202 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:03.730866 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:03.731329 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:03.732174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:03.732617 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:03.880131 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:03.888582 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:03.890221 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:03.891974 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-44d7f02c-2bb7-4a89-b127-7c071b49e8de tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1742 microversion: 2.20 time: 0.173179 Mar 08 19:22:03.892533 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 438/866] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:03 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:04.916980 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:04.917588 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:04.923849 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:04.924621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:04.925396 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:04.925830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:05.075046 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:05.083562 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:05.089834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:05.089834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-451930bb-7781-4a02-b050-0dcdfa0cb258 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1742 microversion: 2.20 time: 0.173331 Mar 08 19:22:05.089834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 429/867] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:04 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:05.313545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-309691843", "imageRef": "e5f013fb-d433-458e-b875-04abe7815634", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eadbce5e-f6fa-402e-acf1-15b1deb0f309"}], "security_groups": [{"name": "tempest-securitygroup--2092704857"}], "key_name": "tempest-keypair-868129316", "user_data": "}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:05.433931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] validate_networks() for [('eadbce5e-f6fa-402e-acf1-15b1deb0f309', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:22:05.856550 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:22:05.857024 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:22:05.857563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:22:05.857975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:22:05.858426 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:22:05.867616 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:05.868106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:05.868908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:05.869343 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:05.885530 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for project ff78af332934469ba0ee399835378e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:22:05.889470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Getting quotas for user d9e2fd821cc84d778f2825c654f29e3d and project ff78af332934469ba0ee399835378e5f. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:22:05.900871 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:22:05.903143 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e5f013fb-d433-458e-b875-04abe7815634',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:22:06.046641 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b3d2edfb-7794-4f90-8818-caf8e4695feb tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.737696 Mar 08 19:22:06.047754 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 439/868] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:22:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:22:06.059910 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-acf7834a-d422-42bf-8ba9-508cb7e4a1e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:06.060647 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-acf7834a-d422-42bf-8ba9-508cb7e4a1e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:06.105928 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:06.106607 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:06.114047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:06.114978 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:06.115498 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:06.116068 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:06.121213 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-acf7834a-d422-42bf-8ba9-508cb7e4a1e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:06.127907 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-acf7834a-d422-42bf-8ba9-508cb7e4a1e8 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1240 microversion: 2.1 time: 0.072428 Mar 08 19:22:06.129036 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 430/869] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:06 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:06.473742 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-865a397c-347b-4d0c-8283-f5e3158ca76a req-5e118b27-4519-47ba-a9aa-c95cc8e8f94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb629d0-2eab-412c-8995-f16c1538c828", "name": "network-vif-plugged", "status": "completed", "tag": "2eb86a7d-edd4-4947-9ef9-4da4449b0e1f"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:06.485881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-865a397c-347b-4d0c-8283-f5e3158ca76a req-5e118b27-4519-47ba-a9aa-c95cc8e8f94b service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:06.486330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-865a397c-347b-4d0c-8283-f5e3158ca76a req-5e118b27-4519-47ba-a9aa-c95cc8e8f94b service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:06.497619 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-865a397c-347b-4d0c-8283-f5e3158ca76a req-5e118b27-4519-47ba-a9aa-c95cc8e8f94b service nova] Creating event network-vif-plugged:2eb86a7d-edd4-4947-9ef9-4da4449b0e1f for instance 2fb629d0-2eab-412c-8995-f16c1538c828 on hv-cinder-83009 Mar 08 19:22:06.503789 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-865a397c-347b-4d0c-8283-f5e3158ca76a req-5e118b27-4519-47ba-a9aa-c95cc8e8f94b service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035556 Mar 08 19:22:06.505264 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 431/870] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:06.538634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:06.546388 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:06.548247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:06.549397 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b2996276-df0d-4946-b09d-81e470408bcd tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1742 microversion: 2.20 time: 0.447663 Mar 08 19:22:06.549943 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 440/871] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:06 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1742 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:22:07.146298 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bbc7ac88-bee5-429c-95be-70e742a4f833 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:07.146931 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-bbc7ac88-bee5-429c-95be-70e742a4f833 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:07.154591 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bbc7ac88-bee5-429c-95be-70e742a4f833 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:07.155050 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bbc7ac88-bee5-429c-95be-70e742a4f833 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:07.155832 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bbc7ac88-bee5-429c-95be-70e742a4f833 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:07.156298 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bbc7ac88-bee5-429c-95be-70e742a4f833 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:07.221466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-bbc7ac88-bee5-429c-95be-70e742a4f833 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:07.228983 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bbc7ac88-bee5-429c-95be-70e742a4f833 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1244 microversion: 2.1 time: 0.086930 Mar 08 19:22:07.229542 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 432/872] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:07 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:22:07.567769 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:07.568353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:07.574624 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:07.575076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:07.575843 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:07.576302 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:07.714169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:07.723536 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:07.725071 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:07.726202 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9a7a9996-9387-4584-9f44-247b453f9821 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1742 microversion: 2.20 time: 0.162518 Mar 08 19:22:07.726752 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 441/873] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:07 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1742 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:08.246053 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a776f933-b428-4146-a1c6-1bf828074b95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:08.246701 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a776f933-b428-4146-a1c6-1bf828074b95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:08.252942 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a776f933-b428-4146-a1c6-1bf828074b95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:08.253393 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a776f933-b428-4146-a1c6-1bf828074b95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:08.254163 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a776f933-b428-4146-a1c6-1bf828074b95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:08.254597 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a776f933-b428-4146-a1c6-1bf828074b95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:08.354013 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a776f933-b428-4146-a1c6-1bf828074b95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:08.362872 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a776f933-b428-4146-a1c6-1bf828074b95 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1300 microversion: 2.1 time: 0.120683 Mar 08 19:22:08.372822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 433/874] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:08 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1300 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:08.744755 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:08.745994 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:08.752847 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:08.753264 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:08.754036 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:08.754465 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:08.992990 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:09.001264 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:09.002793 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:09.003974 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b6db6833-d440-4639-b602-ac9aa5893206 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1742 microversion: 2.20 time: 0.263082 Mar 08 19:22:09.004529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 442/875] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:08 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1742 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:09.381842 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-695cf54e-c303-4642-a543-460b1a6e2489 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:09.383321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-695cf54e-c303-4642-a543-460b1a6e2489 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:09.390985 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-695cf54e-c303-4642-a543-460b1a6e2489 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:09.391815 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-695cf54e-c303-4642-a543-460b1a6e2489 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:09.392998 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-695cf54e-c303-4642-a543-460b1a6e2489 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:09.393477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-695cf54e-c303-4642-a543-460b1a6e2489 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:09.717504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-695cf54e-c303-4642-a543-460b1a6e2489 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:09.726364 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-695cf54e-c303-4642-a543-460b1a6e2489 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.349692 Mar 08 19:22:09.727202 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 434/876] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:09 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:10.024050 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:10.024863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:10.033604 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:10.038724 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:10.041835 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:10.043363 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:10.309028 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:10.342644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:10.342644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:10.342644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cda733d1-6c1c-4870-84f6-fae0408a538f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.308885 Mar 08 19:22:10.350111 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 443/877] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:10 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:10.607845 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-47836768-f42a-43fe-90d5-ddd823dbe290 req-7f5da379-3f97-4d2f-90e6-fba9901ca707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69246580-c8f3-4b73-8f8e-b957fff68f2a", "tag": "53289e48-6128-4777-8871-ee89220f42dc"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:10.619716 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-47836768-f42a-43fe-90d5-ddd823dbe290 req-7f5da379-3f97-4d2f-90e6-fba9901ca707 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:10.620190 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-47836768-f42a-43fe-90d5-ddd823dbe290 req-7f5da379-3f97-4d2f-90e6-fba9901ca707 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:10.644499 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-47836768-f42a-43fe-90d5-ddd823dbe290 req-7f5da379-3f97-4d2f-90e6-fba9901ca707 service nova] Creating event network-changed:53289e48-6128-4777-8871-ee89220f42dc for instance 69246580-c8f3-4b73-8f8e-b957fff68f2a on hv-cinder-83009 Mar 08 19:22:10.652610 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-47836768-f42a-43fe-90d5-ddd823dbe290 req-7f5da379-3f97-4d2f-90e6-fba9901ca707 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048348 Mar 08 19:22:10.653303 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 435/878] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:10.746295 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-77969a52-8730-41d6-bde5-9fa3fd5d12ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:10.746909 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-77969a52-8730-41d6-bde5-9fa3fd5d12ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:10.759329 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-77969a52-8730-41d6-bde5-9fa3fd5d12ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:10.760093 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-77969a52-8730-41d6-bde5-9fa3fd5d12ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:10.761052 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-77969a52-8730-41d6-bde5-9fa3fd5d12ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:10.761646 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-77969a52-8730-41d6-bde5-9fa3fd5d12ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:11.066660 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-77969a52-8730-41d6-bde5-9fa3fd5d12ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:11.078926 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-77969a52-8730-41d6-bde5-9fa3fd5d12ec tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.337215 Mar 08 19:22:11.083826 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 444/879] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:10 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:11.364125 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:11.365214 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:11.373763 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:11.376054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:11.382705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:11.383468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:11.690365 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:11.699321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:11.701924 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:11.703393 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b24a129a-c6f3-4252-9a98-f33a24a517d8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.352335 Mar 08 19:22:11.715515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 436/880] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:11 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:12.099259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d387f6b2-837c-47d5-8428-d860e373ab4f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:12.100794 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d387f6b2-837c-47d5-8428-d860e373ab4f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:12.109822 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d387f6b2-837c-47d5-8428-d860e373ab4f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:12.111122 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d387f6b2-837c-47d5-8428-d860e373ab4f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:12.112208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d387f6b2-837c-47d5-8428-d860e373ab4f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:12.112663 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d387f6b2-837c-47d5-8428-d860e373ab4f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:12.278716 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d387f6b2-837c-47d5-8428-d860e373ab4f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:12.287205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d387f6b2-837c-47d5-8428-d860e373ab4f tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.192272 Mar 08 19:22:12.288612 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 445/881] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:12 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:12.722974 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:12.723747 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:12.730272 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:12.730722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:12.731496 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:12.732008 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:12.893765 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:12.902338 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:12.903843 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:12.905364 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-54ad478c-0fde-4e53-b834-507169107ab1 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.186662 Mar 08 19:22:12.905930 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 437/882] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:12 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:13.305310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-19020a6a-cf20-40ba-ac2d-0a943d2922a1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:13.305908 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-19020a6a-cf20-40ba-ac2d-0a943d2922a1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:13.312333 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-19020a6a-cf20-40ba-ac2d-0a943d2922a1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:13.312782 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-19020a6a-cf20-40ba-ac2d-0a943d2922a1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:13.313559 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-19020a6a-cf20-40ba-ac2d-0a943d2922a1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:13.314501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-19020a6a-cf20-40ba-ac2d-0a943d2922a1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:13.470196 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-19020a6a-cf20-40ba-ac2d-0a943d2922a1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:13.479355 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-19020a6a-cf20-40ba-ac2d-0a943d2922a1 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.177842 Mar 08 19:22:13.480427 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 446/883] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:13 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:13.932021 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:13.932696 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:13.939885 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:13.940356 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:13.941120 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:13.941582 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:14.088888 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:14.101191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:14.102740 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:14.103929 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f17ce880-4669-4c14-8fae-f7d6e4a5a5c6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.183647 Mar 08 19:22:14.117867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 438/884] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:13 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:22:14.499068 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a0ee0d5b-df4d-4509-b1a0-6666ae1bf6b7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:14.499982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a0ee0d5b-df4d-4509-b1a0-6666ae1bf6b7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:14.508253 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d5b-df4d-4509-b1a0-6666ae1bf6b7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:14.508986 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d5b-df4d-4509-b1a0-6666ae1bf6b7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:14.509926 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d5b-df4d-4509-b1a0-6666ae1bf6b7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:14.510682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d5b-df4d-4509-b1a0-6666ae1bf6b7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:14.694760 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a0ee0d5b-df4d-4509-b1a0-6666ae1bf6b7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:14.703242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a0ee0d5b-df4d-4509-b1a0-6666ae1bf6b7 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.208481 Mar 08 19:22:14.704182 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 447/885] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:14 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:15.125525 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:15.126160 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:15.132595 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:15.133398 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:15.134247 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:15.134899 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:15.321666 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:15.331202 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:15.333034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:15.334679 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-52d2d087-a0a4-4869-8d99-6a3a08c0dcdb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.213376 Mar 08 19:22:15.335498 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 439/886] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:15 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:15.723284 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-27e5b07a-1bc3-4cf4-8427-c5ebb75ab87c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:15.723885 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-27e5b07a-1bc3-4cf4-8427-c5ebb75ab87c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:15.731229 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-27e5b07a-1bc3-4cf4-8427-c5ebb75ab87c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:15.731988 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-27e5b07a-1bc3-4cf4-8427-c5ebb75ab87c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:15.733059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-27e5b07a-1bc3-4cf4-8427-c5ebb75ab87c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:15.733727 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-27e5b07a-1bc3-4cf4-8427-c5ebb75ab87c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:15.905931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-27e5b07a-1bc3-4cf4-8427-c5ebb75ab87c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:15.914931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-27e5b07a-1bc3-4cf4-8427-c5ebb75ab87c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.197625 Mar 08 19:22:15.915536 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 448/887] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:15 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:16.354105 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:16.354713 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:16.360751 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:16.361209 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:16.361981 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:16.362421 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:16.542376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:16.542376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:16.542774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:16.542774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d784cb1d-92e3-490a-9614-9cd30da4d653 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.165247 Mar 08 19:22:16.542774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 440/888] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:16 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:16.934653 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-eac92f6a-0b61-4aea-9999-da43ee75c8b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:16.935248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-eac92f6a-0b61-4aea-9999-da43ee75c8b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:16.942855 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-eac92f6a-0b61-4aea-9999-da43ee75c8b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:16.943313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-eac92f6a-0b61-4aea-9999-da43ee75c8b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:16.944172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-eac92f6a-0b61-4aea-9999-da43ee75c8b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:16.944605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-eac92f6a-0b61-4aea-9999-da43ee75c8b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:17.106246 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-eac92f6a-0b61-4aea-9999-da43ee75c8b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:17.116282 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-eac92f6a-0b61-4aea-9999-da43ee75c8b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.185532 Mar 08 19:22:17.117189 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 449/889] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:16 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:17.561775 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:17.562542 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:17.570272 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:17.570728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:17.571543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:17.572012 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:17.744122 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:17.753628 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:17.755957 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:17.757138 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a2d03bf6-d83e-488c-9840-7dba1b68cf47 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.202085 Mar 08 19:22:17.769162 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 441/890] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:17 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:18.133937 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-205b3eec-c425-46bc-9cf2-e830797b4202 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:18.134478 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-205b3eec-c425-46bc-9cf2-e830797b4202 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:18.142791 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-205b3eec-c425-46bc-9cf2-e830797b4202 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:18.143678 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-205b3eec-c425-46bc-9cf2-e830797b4202 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:18.144764 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-205b3eec-c425-46bc-9cf2-e830797b4202 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:18.145439 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-205b3eec-c425-46bc-9cf2-e830797b4202 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:18.314249 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-205b3eec-c425-46bc-9cf2-e830797b4202 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:18.325007 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-205b3eec-c425-46bc-9cf2-e830797b4202 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.195508 Mar 08 19:22:18.327298 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 450/891] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:18 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:18.679200 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-31e88bc6-5244-4979-befe-ab1083e74500 req-96d8b432-0187-4efd-badd-4f7865f47f55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69246580-c8f3-4b73-8f8e-b957fff68f2a", "name": "network-vif-plugged", "status": "completed", "tag": "53289e48-6128-4777-8871-ee89220f42dc"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:18.688158 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-31e88bc6-5244-4979-befe-ab1083e74500 req-96d8b432-0187-4efd-badd-4f7865f47f55 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:18.688648 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-31e88bc6-5244-4979-befe-ab1083e74500 req-96d8b432-0187-4efd-badd-4f7865f47f55 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:18.703822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-31e88bc6-5244-4979-befe-ab1083e74500 req-96d8b432-0187-4efd-badd-4f7865f47f55 service nova] Creating event network-vif-plugged:53289e48-6128-4777-8871-ee89220f42dc for instance 69246580-c8f3-4b73-8f8e-b957fff68f2a on hv-cinder-83009 Mar 08 19:22:18.710980 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-31e88bc6-5244-4979-befe-ab1083e74500 req-96d8b432-0187-4efd-badd-4f7865f47f55 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035776 Mar 08 19:22:18.714644 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 442/892] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:18.776654 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:18.777855 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:18.789446 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:18.790182 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:18.792674 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:18.793336 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:18.968894 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:18.979956 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:18.982495 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:18.983975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4b831438-cf93-4496-885d-9542bbaca7ba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.212056 Mar 08 19:22:19.007265 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 451/893] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:18 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:19.343220 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2f12ff78-89cb-491a-9d95-e7772708d40a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:19.344210 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2f12ff78-89cb-491a-9d95-e7772708d40a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:19.350743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f12ff78-89cb-491a-9d95-e7772708d40a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:19.351554 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f12ff78-89cb-491a-9d95-e7772708d40a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:19.352630 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f12ff78-89cb-491a-9d95-e7772708d40a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:19.353342 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2f12ff78-89cb-491a-9d95-e7772708d40a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:19.515084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2f12ff78-89cb-491a-9d95-e7772708d40a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:19.524574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2f12ff78-89cb-491a-9d95-e7772708d40a tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.185548 Mar 08 19:22:19.525262 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 443/894] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:19 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:20.005994 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:20.011778 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:20.019035 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:20.019482 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:20.020309 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:20.020778 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:20.163356 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:20.172327 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:20.175156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:20.176362 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-89aa25df-f487-43ae-bbe8-e33bb0fa6515 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.175221 Mar 08 19:22:20.176920 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 452/895] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:19 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:22:20.542584 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6e729d3c-1036-42b5-afc3-59de09186828 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:20.543194 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6e729d3c-1036-42b5-afc3-59de09186828 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:20.549996 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e729d3c-1036-42b5-afc3-59de09186828 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:20.550446 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e729d3c-1036-42b5-afc3-59de09186828 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:20.551210 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e729d3c-1036-42b5-afc3-59de09186828 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:20.551639 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6e729d3c-1036-42b5-afc3-59de09186828 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:20.719392 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6e729d3c-1036-42b5-afc3-59de09186828 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:20.727888 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6e729d3c-1036-42b5-afc3-59de09186828 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1366 microversion: 2.1 time: 0.189713 Mar 08 19:22:20.728621 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 444/896] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:20 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:21.195379 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:21.196192 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:21.202369 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:21.202819 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:21.203616 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:21.204171 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:21.360417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:21.368945 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:21.370524 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:21.371667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-31dba0c1-c090-4dc8-9761-855dfbd6757e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.180337 Mar 08 19:22:21.372247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 453/897] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:21 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:21.746482 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ddd89cc8-36ac-4200-a377-6bf39dbc43a3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:21.747113 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ddd89cc8-36ac-4200-a377-6bf39dbc43a3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:21.754333 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ddd89cc8-36ac-4200-a377-6bf39dbc43a3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:21.754786 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ddd89cc8-36ac-4200-a377-6bf39dbc43a3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:21.755816 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ddd89cc8-36ac-4200-a377-6bf39dbc43a3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:21.756300 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ddd89cc8-36ac-4200-a377-6bf39dbc43a3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:21.895246 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ddd89cc8-36ac-4200-a377-6bf39dbc43a3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:21.902607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ddd89cc8-36ac-4200-a377-6bf39dbc43a3 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1556 microversion: 2.1 time: 0.160187 Mar 08 19:22:21.903169 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 445/898] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:21 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:22:21.919332 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ae60514a-48b0-4708-a608-49b1784209be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:21.919839 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ae60514a-48b0-4708-a608-49b1784209be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:21.926573 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae60514a-48b0-4708-a608-49b1784209be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:21.927092 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae60514a-48b0-4708-a608-49b1784209be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:21.927969 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae60514a-48b0-4708-a608-49b1784209be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:21.928365 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae60514a-48b0-4708-a608-49b1784209be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:22.010037 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ae60514a-48b0-4708-a608-49b1784209be tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094638 Mar 08 19:22:22.010626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 454/899] 10.222.0.75 () {58 vars in 1274 bytes} [Tue Mar 8 19:22:21 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:22.390578 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:22.391185 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:22.397746 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:22.398796 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:22.399599 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:22.400043 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:22.590994 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:22.599023 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:22.603722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:22.603722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ff328d61-2c4c-44d6-b252-f16fd585c973 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1737 microversion: 2.20 time: 0.215084 Mar 08 19:22:22.603722 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 446/900] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:22 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:23.621852 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:23.621852 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:23.629733 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:23.629942 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:23.630918 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:23.631573 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:23.670278 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-c44c2659-f51c-42f5-9135-0a90e47eee1b req-432dc88c-117c-48a3-abcd-f6ea8f0dc39c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69246580-c8f3-4b73-8f8e-b957fff68f2a", "tag": "53289e48-6128-4777-8871-ee89220f42dc"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:23.678833 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-c44c2659-f51c-42f5-9135-0a90e47eee1b req-432dc88c-117c-48a3-abcd-f6ea8f0dc39c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:23.679365 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-c44c2659-f51c-42f5-9135-0a90e47eee1b req-432dc88c-117c-48a3-abcd-f6ea8f0dc39c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:23.691551 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-c44c2659-f51c-42f5-9135-0a90e47eee1b req-432dc88c-117c-48a3-abcd-f6ea8f0dc39c service nova] Creating event network-changed:53289e48-6128-4777-8871-ee89220f42dc for instance 69246580-c8f3-4b73-8f8e-b957fff68f2a on hv-cinder-83009 Mar 08 19:22:23.696841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-c44c2659-f51c-42f5-9135-0a90e47eee1b req-432dc88c-117c-48a3-abcd-f6ea8f0dc39c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029964 Mar 08 19:22:23.698123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 447/901] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:23.947855 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:23.957020 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:23.958659 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:23.959876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-bc465748-0a7c-4b67-8711-4265ae088cc3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1719 microversion: 2.20 time: 0.343050 Mar 08 19:22:23.960476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 455/902] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:23 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1719 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:24.980239 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:24.980932 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:24.987457 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:24.987877 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:24.988659 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:24.989092 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:25.129160 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:25.137066 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:25.138561 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:25.139697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7d0f0e4e-6412-4f15-bd1f-2eb7794b3d75 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1719 microversion: 2.20 time: 0.163726 Mar 08 19:22:25.140285 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 448/903] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:24 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:26.158827 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:26.159436 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:26.166249 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:26.166692 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:26.167464 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:26.167898 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:26.302940 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:26.310693 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:26.312216 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:26.313940 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8acb88e8-5700-43ba-a029-f49c17ebf3f6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1722 microversion: 2.20 time: 0.159032 Mar 08 19:22:26.314636 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 456/904] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:26 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:26.332263 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bef7733a-d92c-4ead-a42d-a762f5079df9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49c80506-1a57-43b9-a9e2-cb4e634ca133"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:26.333316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-bef7733a-d92c-4ead-a42d-a762f5079df9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:26.339763 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bef7733a-d92c-4ead-a42d-a762f5079df9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:26.340263 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bef7733a-d92c-4ead-a42d-a762f5079df9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:26.341044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bef7733a-d92c-4ead-a42d-a762f5079df9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:26.341485 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bef7733a-d92c-4ead-a42d-a762f5079df9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:26.482296 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-10533ff3-5f77-485c-b845-e08227ae012e req-c66abb71-e3ee-4e37-bf75-8c8f6b87777d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb629d0-2eab-412c-8995-f16c1538c828", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb86a7d-edd4-4947-9ef9-4da4449b0e1f"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:26.491242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-10533ff3-5f77-485c-b845-e08227ae012e req-c66abb71-e3ee-4e37-bf75-8c8f6b87777d service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:26.491680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-10533ff3-5f77-485c-b845-e08227ae012e req-c66abb71-e3ee-4e37-bf75-8c8f6b87777d service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:26.504220 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-10533ff3-5f77-485c-b845-e08227ae012e req-c66abb71-e3ee-4e37-bf75-8c8f6b87777d service nova] Creating event network-vif-unplugged:2eb86a7d-edd4-4947-9ef9-4da4449b0e1f for instance 2fb629d0-2eab-412c-8995-f16c1538c828 on hv-cinder-83009 Mar 08 19:22:26.510274 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-10533ff3-5f77-485c-b845-e08227ae012e req-c66abb71-e3ee-4e37-bf75-8c8f6b87777d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031371 Mar 08 19:22:26.510859 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 457/905] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:22:27.221618 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bef7733a-d92c-4ead-a42d-a762f5079df9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.893852 Mar 08 19:22:27.223214 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 449/906] 10.222.0.75 () {62 vars in 1363 bytes} [Tue Mar 8 19:22:26 2022] POST /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/os-volume_attachments => generated 188 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 08 19:22:27.339356 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9d4058b9-0f47-4e46-9f2c-4ed515b559c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:27.340005 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9d4058b9-0f47-4e46-9f2c-4ed515b559c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:27.347452 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9d4058b9-0f47-4e46-9f2c-4ed515b559c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:27.347904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9d4058b9-0f47-4e46-9f2c-4ed515b559c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:27.348702 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9d4058b9-0f47-4e46-9f2c-4ed515b559c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:27.349146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9d4058b9-0f47-4e46-9f2c-4ed515b559c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:28.020970 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9d4058b9-0f47-4e46-9f2c-4ed515b559c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/os-volume_attachments/49c80506-1a57-43b9-a9e2-cb4e634ca133" status: 202 len: 0 microversion: 2.20 time: 0.685905 Mar 08 19:22:28.021565 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 458/907] 10.222.0.75 () {60 vars in 1456 bytes} [Tue Mar 8 19:22:27 2022] DELETE /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/os-volume_attachments/49c80506-1a57-43b9-a9e2-cb4e634ca133 => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:22:28.080578 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-185533a1-32b6-490e-b4ad-e3ffeb078696 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:28.081146 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-185533a1-32b6-490e-b4ad-e3ffeb078696 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:28.088122 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-185533a1-32b6-490e-b4ad-e3ffeb078696 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:28.088579 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-185533a1-32b6-490e-b4ad-e3ffeb078696 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:28.089360 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-185533a1-32b6-490e-b4ad-e3ffeb078696 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:28.089805 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-185533a1-32b6-490e-b4ad-e3ffeb078696 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:28.496757 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-185533a1-32b6-490e-b4ad-e3ffeb078696 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "POST /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/action" status: 202 len: 0 microversion: 2.20 time: 0.421539 Mar 08 19:22:28.497365 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 450/908] 10.222.0.75 () {62 vars in 1318 bytes} [Tue Mar 8 19:22:28 2022] POST /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:22:28.505808 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:28.508155 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:28.512736 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:28.513188 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:28.513960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:28.514396 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:28.656877 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:28.664805 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:28.666321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:28.667470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ff1c89bb-9cb1-4ae6-b22d-62513f91cd60 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1670 microversion: 2.20 time: 0.165882 Mar 08 19:22:28.668039 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 459/909] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:28 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:29.687077 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:29.687728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:29.694370 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:29.694822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:29.695584 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:29.696045 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:29.834575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:29.843126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:29.844752 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:29.845956 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-929fe984-4cf3-4cda-9505-68370e75a4b9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1670 microversion: 2.20 time: 0.163286 Mar 08 19:22:29.846697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 451/910] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:29 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:30.865794 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:30.866411 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:30.872879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:30.873337 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:30.874121 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:30.874562 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:31.146884 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:31.155020 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:31.156568 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:31.158500 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-af24b2bb-7c12-4bf7-bce0-3f8c662c7576 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.296444 Mar 08 19:22:31.169499 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 460/911] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:30 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:32.179091 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:32.179899 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:32.188047 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:32.188832 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:32.190144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:32.190807 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:32.351352 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:32.360044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:32.361598 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:32.363145 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-43c6befb-5256-4b24-b11b-fd59cf6001a3 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.188810 Mar 08 19:22:32.363958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 452/912] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:32 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:33.382902 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:33.383453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:33.389871 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:33.390353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:33.391911 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:33.392372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:33.534120 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:33.542487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:33.544091 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:33.545229 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4bfa8500-9ddb-4508-ab30-12b7ea4563ef tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.166626 Mar 08 19:22:33.546134 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 461/913] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:33 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:34.564426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:34.565158 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:34.571401 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:34.571847 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:34.572654 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:34.573087 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:34.721565 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:34.729707 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:34.731236 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:34.732924 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f4b0cc55-819e-4287-b936-2c3c2c824802 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.173253 Mar 08 19:22:34.733819 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 453/914] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:34 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:35.750931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:35.751720 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:35.764978 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:35.765391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:35.766239 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:35.766694 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:35.928963 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:35.937531 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:35.939857 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:35.941093 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-87bcc153-0314-45ae-9f44-8c88fb568243 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.194360 Mar 08 19:22:35.941678 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 462/915] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:35 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:36.959480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:36.960185 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:36.966825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:36.967282 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:36.968121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:36.968596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:37.107317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:37.118120 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:37.119933 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:37.123646 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7747658d-cf87-448d-9d27-cecbbf1f0f1a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.166071 Mar 08 19:22:37.123646 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 454/916] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:36 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:38.147446 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:38.148293 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:38.154743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:38.155202 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:38.156003 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:38.156482 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:38.345144 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:38.354830 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:38.357222 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:38.358874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-8b2d68f1-2887-41a5-83d1-2201360dcc6f tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.215368 Mar 08 19:22:38.359434 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 463/917] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:38 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:39.394834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:39.394834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:39.394834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:39.394834 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:39.396309 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:39.396309 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:39.542987 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:39.552906 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:39.560035 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:39.560035 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e881ca1d-8ca1-4d03-9717-333c8a5b6531 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.180937 Mar 08 19:22:39.560035 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 455/918] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:39 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:40.574781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:40.575508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:40.581874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:40.582329 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:40.583242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:40.583557 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:40.734897 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:40.743539 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:40.745152 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:40.746326 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-85d1fccf-48e5-40b1-9baa-b71157b40284 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.175483 Mar 08 19:22:40.747160 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 464/919] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:40 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:22:41.765092 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:41.766367 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:41.772962 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:41.773388 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:41.774185 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:41.774658 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:41.929901 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:41.938764 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:41.940341 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:41.941524 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bde861ed-751a-45ae-8a3a-eb62baf641c5 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.180504 Mar 08 19:22:41.942191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 456/920] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:41 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:42.960042 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:42.960647 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:42.966931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:42.967384 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:42.968176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:42.968611 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:43.101012 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:43.108705 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:43.111105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:43.112328 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-96103079-aa59-4bb5-a71b-5f443ef322be tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.156264 Mar 08 19:22:43.112914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 465/921] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:42 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:44.130978 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:44.131881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:44.138534 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:44.139030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:44.139843 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:44.140349 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:44.286437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:44.294208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:44.295711 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:44.297515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ba3c582f-e3c0-48c8-b805-2a9720cbe88e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.170325 Mar 08 19:22:44.298320 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 457/922] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:44 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:45.321405 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:45.321405 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:45.323483 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:45.323947 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:45.324719 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:45.325156 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:45.463312 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:45.471288 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:45.472847 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:45.473999 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ab15d5ea-c215-4356-8692-f3c06a044b77 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.161922 Mar 08 19:22:45.474548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 466/923] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:45 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:46.492697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:46.493414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:46.500257 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:46.500917 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:46.501730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:46.502169 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:46.634360 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:46.642995 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:46.644542 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:46.645686 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e3f9463e-3f49-4a89-aa98-9800b372624a tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.157064 Mar 08 19:22:46.646229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 458/924] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:46 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:47.663304 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:47.663955 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:47.670353 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:47.670742 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:47.671501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:47.671950 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:47.807935 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:47.816285 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:47.817787 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:47.818954 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-bda404c0-5bf5-43eb-a2f0-b8eb3b4f75d6 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.159659 Mar 08 19:22:47.819508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 467/925] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:47 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:48.770368 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4224d5af-8c85-4b8a-8797-406b0472b190 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-460715053"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:48.770958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4224d5af-8c85-4b8a-8797-406b0472b190 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:48.777106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4224d5af-8c85-4b8a-8797-406b0472b190 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:48.777537 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4224d5af-8c85-4b8a-8797-406b0472b190 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:48.778331 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4224d5af-8c85-4b8a-8797-406b0472b190 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:48.778830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4224d5af-8c85-4b8a-8797-406b0472b190 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:48.836727 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:48.837455 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:48.843714 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:48.844211 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:48.845063 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:48.846044 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:48.950071 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.network.security_group_api [None req-4224d5af-8c85-4b8a-8797-406b0472b190 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Removing security group fac173b8-1244-482f-9c3f-ef19a73c1d2c from port ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 Mar 08 19:22:49.049787 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:49.057692 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:49.059768 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:49.060599 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-dd6093e1-21bf-4636-b459-550aa00897e9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.227872 Mar 08 19:22:49.061236 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 468/926] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:48 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:22:49.405093 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4224d5af-8c85-4b8a-8797-406b0472b190 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "POST /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/action" status: 202 len: 0 microversion: 2.1 time: 0.639343 Mar 08 19:22:49.415353 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 459/927] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:22:48 2022] POST /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:22:49.418728 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-300e115d-1327-46af-83c7-efa690657c08 req-5abf3bc7-a458-47c4-83e6-5f9f5da2740c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04abbb21-ab32-456a-b9e5-eda0284c067c", "tag": "ffb7e097-a3bb-4d3a-8540-5b1eda1926a0"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:49.436120 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-300e115d-1327-46af-83c7-efa690657c08 req-5abf3bc7-a458-47c4-83e6-5f9f5da2740c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:49.436953 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-300e115d-1327-46af-83c7-efa690657c08 req-5abf3bc7-a458-47c4-83e6-5f9f5da2740c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:49.452186 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-300e115d-1327-46af-83c7-efa690657c08 req-5abf3bc7-a458-47c4-83e6-5f9f5da2740c service nova] Creating event network-changed:ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 for instance 04abbb21-ab32-456a-b9e5-eda0284c067c on hv-cinder-83009 Mar 08 19:22:49.458093 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-300e115d-1327-46af-83c7-efa690657c08 req-5abf3bc7-a458-47c4-83e6-5f9f5da2740c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045318 Mar 08 19:22:49.459360 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 469/928] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:50.083123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:50.084073 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:50.092100 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:50.092789 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:50.093965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:50.094632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:50.301691 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:50.310051 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:50.311547 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:50.312880 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f1476328-12f6-4462-a39b-5a8b7d15d196 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.236181 Mar 08 19:22:50.313454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 460/929] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:50 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:50.647546 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-65d21f2d-7240-4d8d-8a80-03bb88e50405 req-3e947742-afde-420b-8355-7d4c92ea3df3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb629d0-2eab-412c-8995-f16c1538c828", "name": "network-vif-plugged", "status": "completed", "tag": "2eb86a7d-edd4-4947-9ef9-4da4449b0e1f"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:50.658212 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-65d21f2d-7240-4d8d-8a80-03bb88e50405 req-3e947742-afde-420b-8355-7d4c92ea3df3 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:50.658627 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-65d21f2d-7240-4d8d-8a80-03bb88e50405 req-3e947742-afde-420b-8355-7d4c92ea3df3 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:50.671774 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-65d21f2d-7240-4d8d-8a80-03bb88e50405 req-3e947742-afde-420b-8355-7d4c92ea3df3 service nova] Creating event network-vif-plugged:2eb86a7d-edd4-4947-9ef9-4da4449b0e1f for instance 2fb629d0-2eab-412c-8995-f16c1538c828 on hv-cinder-83009 Mar 08 19:22:50.677567 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-65d21f2d-7240-4d8d-8a80-03bb88e50405 req-3e947742-afde-420b-8355-7d4c92ea3df3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034608 Mar 08 19:22:50.678238 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 470/930] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:22:50.836608 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-19170e96-b693-4835-a25a-602f7c038e47 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:50.838205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-19170e96-b693-4835-a25a-602f7c038e47 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:50.838697 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-7522f7dc-4b70-4a43-970a-da5fa2b2e26c req-0e9052bc-d58b-409b-935f-37b3a041621c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04abbb21-ab32-456a-b9e5-eda0284c067c", "tag": "ffb7e097-a3bb-4d3a-8540-5b1eda1926a0"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:50.847034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-19170e96-b693-4835-a25a-602f7c038e47 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:50.849976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-7522f7dc-4b70-4a43-970a-da5fa2b2e26c req-0e9052bc-d58b-409b-935f-37b3a041621c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:50.850110 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-19170e96-b693-4835-a25a-602f7c038e47 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:50.850212 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-7522f7dc-4b70-4a43-970a-da5fa2b2e26c req-0e9052bc-d58b-409b-935f-37b3a041621c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:50.850315 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-19170e96-b693-4835-a25a-602f7c038e47 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:50.850507 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-19170e96-b693-4835-a25a-602f7c038e47 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:50.859895 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-7522f7dc-4b70-4a43-970a-da5fa2b2e26c req-0e9052bc-d58b-409b-935f-37b3a041621c service nova] Creating event network-changed:ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 for instance 04abbb21-ab32-456a-b9e5-eda0284c067c on hv-cinder-83009 Mar 08 19:22:50.865737 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-7522f7dc-4b70-4a43-970a-da5fa2b2e26c req-0e9052bc-d58b-409b-935f-37b3a041621c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031411 Mar 08 19:22:50.866741 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 471/931] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:22:50.953347 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-19170e96-b693-4835-a25a-602f7c038e47 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lazy-loading 'services' on Instance uuid 04abbb21-ab32-456a-b9e5-eda0284c067c {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:22:51.181098 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-19170e96-b693-4835-a25a-602f7c038e47 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments/50afbe78-a522-45a0-befb-1b57e680187c" status: 202 len: 0 microversion: 2.1 time: 0.348853 Mar 08 19:22:51.182557 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 461/932] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:22:50 2022] DELETE /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments/50afbe78-a522-45a0-befb-1b57e680187c => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:22:51.203239 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-48f30be0-97e0-4141-b8e1-9a423e251872 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:51.205070 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-48f30be0-97e0-4141-b8e1-9a423e251872 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:51.217403 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48f30be0-97e0-4141-b8e1-9a423e251872 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:51.217856 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48f30be0-97e0-4141-b8e1-9a423e251872 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:51.218659 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48f30be0-97e0-4141-b8e1-9a423e251872 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:51.219176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48f30be0-97e0-4141-b8e1-9a423e251872 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:51.257014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-48f30be0-97e0-4141-b8e1-9a423e251872 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068764 Mar 08 19:22:51.257868 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 472/933] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:22:51 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:51.335508 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:51.336649 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:51.344313 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:51.345479 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:51.347299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:51.348022 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:51.619184 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:51.629201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:51.631163 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:51.632389 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-79782893-da1a-420a-8cb8-ef866f255eea tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.303183 Mar 08 19:22:51.632948 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 462/934] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:51 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:22:52.269277 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-acec1dfc-d715-4b64-b6bf-da8a37ecff24 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:52.270240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-acec1dfc-d715-4b64-b6bf-da8a37ecff24 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:52.276756 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-acec1dfc-d715-4b64-b6bf-da8a37ecff24 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:52.277194 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-acec1dfc-d715-4b64-b6bf-da8a37ecff24 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:52.277960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-acec1dfc-d715-4b64-b6bf-da8a37ecff24 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:52.278390 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-acec1dfc-d715-4b64-b6bf-da8a37ecff24 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:52.308419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-acec1dfc-d715-4b64-b6bf-da8a37ecff24 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043527 Mar 08 19:22:52.309050 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 473/935] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:22:52 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:52.650779 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:52.651395 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:52.657702 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:52.658338 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:52.658921 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:52.659361 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:52.801433 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:52.809153 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:52.810685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:52.811813 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a17b2082-3cc3-4651-8349-2b3cf273ae04 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.165100 Mar 08 19:22:52.812388 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 463/936] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:52 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:53.323422 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-12b416a1-cdb6-4908-b307-f903a89544f9 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:53.330709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-12b416a1-cdb6-4908-b307-f903a89544f9 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:53.330709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12b416a1-cdb6-4908-b307-f903a89544f9 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:53.330941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12b416a1-cdb6-4908-b307-f903a89544f9 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:53.331704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12b416a1-cdb6-4908-b307-f903a89544f9 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:53.332162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12b416a1-cdb6-4908-b307-f903a89544f9 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:53.361927 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-12b416a1-cdb6-4908-b307-f903a89544f9 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043011 Mar 08 19:22:53.362476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 474/937] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:22:53 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:22:53.372241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:53.372743 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:53.379660 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:53.380399 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:53.384259 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:53.384259 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:53.454461 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] HTTP exception thrown: Instance 04abbb21-ab32-456a-b9e5-eda0284c067c is not attached to volume 50afbe78-a522-45a0-befb-1b57e680187c Mar 08 19:22:53.455170 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Returning 404 to user: Instance 04abbb21-ab32-456a-b9e5-eda0284c067c is not attached to volume 50afbe78-a522-45a0-befb-1b57e680187c {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:22:53.456160 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-94fb7afc-6800-4c96-96ff-d1ac45b5d4c1 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments/50afbe78-a522-45a0-befb-1b57e680187c" status: 404 len: 154 microversion: 2.1 time: 0.087779 Mar 08 19:22:53.456576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 464/938] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:22:53 2022] DELETE /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c/os-volume_attachments/50afbe78-a522-45a0-befb-1b57e680187c => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:22:53.831166 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:53.831786 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:53.837838 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:53.838289 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:53.839065 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:53.839497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:53.972753 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:53.980575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:53.982108 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:53.983268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2fb4d05e-51bb-4484-abc6-4ec0f758067b tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1728 microversion: 2.20 time: 0.156727 Mar 08 19:22:53.983827 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 475/939] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:53 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:22:54.830059 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-215e8758-a114-439b-b46b-0f4c47c0a984 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:54.830615 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-215e8758-a114-439b-b46b-0f4c47c0a984 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:54.836791 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-215e8758-a114-439b-b46b-0f4c47c0a984 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:54.837242 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-215e8758-a114-439b-b46b-0f4c47c0a984 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:54.838010 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-215e8758-a114-439b-b46b-0f4c47c0a984 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:54.838444 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-215e8758-a114-439b-b46b-0f4c47c0a984 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:54.862293 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-215e8758-a114-439b-b46b-0f4c47c0a984 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Going to try to terminate instance {{(pid=117390) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:22:55.002934 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:55.003594 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:55.010168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:55.010623 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:55.011394 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:55.011825 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:55.151371 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:55.160178 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:55.161760 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:55.162930 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0c92262f-019e-4c89-857e-3507a0eccf8c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1715 microversion: 2.20 time: 0.164638 Mar 08 19:22:55.163481 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 476/940] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:22:54 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 08 19:22:55.216827 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7427f090-2439-4f3f-a777-f8603ea5a96c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:55.217315 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7427f090-2439-4f3f-a777-f8603ea5a96c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:55.223858 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7427f090-2439-4f3f-a777-f8603ea5a96c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:55.224325 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7427f090-2439-4f3f-a777-f8603ea5a96c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:55.225098 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7427f090-2439-4f3f-a777-f8603ea5a96c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:55.225529 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7427f090-2439-4f3f-a777-f8603ea5a96c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:55.248108 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7427f090-2439-4f3f-a777-f8603ea5a96c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/ips" status: 200 len: 146 microversion: 2.1 time: 0.035082 Mar 08 19:22:55.248670 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 477/941] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:22:55 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:22:55.261501 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-215e8758-a114-439b-b46b-0f4c47c0a984 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "DELETE /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 204 len: 0 microversion: 2.1 time: 0.434947 Mar 08 19:22:55.262009 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 465/942] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:22:54 2022] DELETE /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:22:55.269937 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-bb16f177-756a-4dc6-a381-61e6ef818c4e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:55.270573 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-bb16f177-756a-4dc6-a381-61e6ef818c4e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:55.276504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bb16f177-756a-4dc6-a381-61e6ef818c4e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:55.277124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bb16f177-756a-4dc6-a381-61e6ef818c4e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:55.277802 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bb16f177-756a-4dc6-a381-61e6ef818c4e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:55.278235 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bb16f177-756a-4dc6-a381-61e6ef818c4e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:55.411759 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bb16f177-756a-4dc6-a381-61e6ef818c4e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:55.419264 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-bb16f177-756a-4dc6-a381-61e6ef818c4e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1553 microversion: 2.1 time: 0.153167 Mar 08 19:22:55.419843 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 478/943] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:55 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:56.436955 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b2616701-7515-48ce-a357-fab19208409e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:56.437661 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b2616701-7515-48ce-a357-fab19208409e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:56.444887 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b2616701-7515-48ce-a357-fab19208409e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:56.445338 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b2616701-7515-48ce-a357-fab19208409e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:56.446105 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b2616701-7515-48ce-a357-fab19208409e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:56.446545 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b2616701-7515-48ce-a357-fab19208409e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:56.579539 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b2616701-7515-48ce-a357-fab19208409e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:56.587392 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b2616701-7515-48ce-a357-fab19208409e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1553 microversion: 2.1 time: 0.154669 Mar 08 19:22:56.587965 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 466/944] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:56 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:56.890768 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-885fd4ec-9abf-4f2c-8f59-0f2c5cd78023 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5c3fef3-6225-4140-ad25-36336f51c2d1"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:56.891881 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-885fd4ec-9abf-4f2c-8f59-0f2c5cd78023 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:56.898951 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-885fd4ec-9abf-4f2c-8f59-0f2c5cd78023 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:56.903839 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-885fd4ec-9abf-4f2c-8f59-0f2c5cd78023 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:56.903839 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-885fd4ec-9abf-4f2c-8f59-0f2c5cd78023 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:56.903839 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-885fd4ec-9abf-4f2c-8f59-0f2c5cd78023 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:57.605740 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f21bbecc-1356-4d7b-89e9-bb8ac4e1122b tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:57.606367 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f21bbecc-1356-4d7b-89e9-bb8ac4e1122b tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:57.613611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f21bbecc-1356-4d7b-89e9-bb8ac4e1122b tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:57.614062 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f21bbecc-1356-4d7b-89e9-bb8ac4e1122b tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:57.614851 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f21bbecc-1356-4d7b-89e9-bb8ac4e1122b tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:57.615281 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f21bbecc-1356-4d7b-89e9-bb8ac4e1122b tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:57.806439 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f21bbecc-1356-4d7b-89e9-bb8ac4e1122b tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:57.813966 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f21bbecc-1356-4d7b-89e9-bb8ac4e1122b tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1553 microversion: 2.1 time: 0.212114 Mar 08 19:22:57.814524 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 467/945] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:57 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:22:57.954361 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-76c334fd-3fb9-4d12-9e82-8e6cd82730ec req-edfde403-33e0-4209-8679-c6b882948dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04abbb21-ab32-456a-b9e5-eda0284c067c", "name": "network-vif-deleted", "tag": "ffb7e097-a3bb-4d3a-8540-5b1eda1926a0"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:22:57.962827 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-76c334fd-3fb9-4d12-9e82-8e6cd82730ec req-edfde403-33e0-4209-8679-c6b882948dc3 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:57.963287 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-76c334fd-3fb9-4d12-9e82-8e6cd82730ec req-edfde403-33e0-4209-8679-c6b882948dc3 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:57.974660 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-76c334fd-3fb9-4d12-9e82-8e6cd82730ec req-edfde403-33e0-4209-8679-c6b882948dc3 service nova] Creating event network-vif-deleted:ffb7e097-a3bb-4d3a-8540-5b1eda1926a0 for instance 04abbb21-ab32-456a-b9e5-eda0284c067c on hv-cinder-83009 Mar 08 19:22:57.979883 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-76c334fd-3fb9-4d12-9e82-8e6cd82730ec req-edfde403-33e0-4209-8679-c6b882948dc3 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029134 Mar 08 19:22:57.982399 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 468/946] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:57.988062 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-885fd4ec-9abf-4f2c-8f59-0f2c5cd78023 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.099964 Mar 08 19:22:57.988958 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 479/947] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:22:56 2022] POST /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments => generated 194 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:22:58.833525 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:58.834233 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:58.841011 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:58.841467 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:58.842250 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:58.842688 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:58.874944 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:58.875423 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:58.875881 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lazy-loading 'fault' on Instance uuid 04abbb21-ab32-456a-b9e5-eda0284c067c {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:22:58.923092 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a3d5cc6203f43c8abd03abc42b65915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8493e87c10e641d683d44e78c2f7c51b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:22:58.930645 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1019a882-c04f-433e-a03e-fb875ab0cc5f tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 200 len: 1347 microversion: 2.1 time: 0.102566 Mar 08 19:22:58.931203 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 469/948] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:58 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:22:59.948689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:22:59.949419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] [instance: 04abbb21-ab32-456a-b9e5-eda0284c067c] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:22:59.955997 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:59.956450 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:59.957207 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:22:59.957642 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:22:59.971060 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] HTTP exception thrown: Instance 04abbb21-ab32-456a-b9e5-eda0284c067c could not be found. Mar 08 19:22:59.971634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Returning 404 to user: Instance 04abbb21-ab32-456a-b9e5-eda0284c067c could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:22:59.972463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e195ac2c-fa65-44d4-b5a3-415d2e798b1e tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c" status: 404 len: 111 microversion: 2.1 time: 0.028104 Mar 08 19:22:59.972983 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 480/949] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:22:59 2022] GET /compute/v2.1/servers/04abbb21-ab32-456a-b9e5-eda0284c067c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:22:59.981058 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c7494190-9446-49bd-bdb3-dd8fe87a2ed2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] Calling method '.version_select at 0x7f4383614a60>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:00.056148 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c7494190-9446-49bd-bdb3-dd8fe87a2ed2 tempest-TestMinimumBasicScenario-2135638103 tempest-TestMinimumBasicScenario-2135638103-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-828483359" status: 202 len: 0 microversion: 2.1 time: 0.078749 Mar 08 19:23:00.056726 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 470/950] 10.222.0.75 () {58 vars in 1268 bytes} [Tue Mar 8 19:22:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-828483359 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:23:05.492931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-00526a43-dafc-46df-8f0a-8ed1cc65040f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:05.492931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-00526a43-dafc-46df-8f0a-8ed1cc65040f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:05.497588 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-00526a43-dafc-46df-8f0a-8ed1cc65040f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:05.498105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-00526a43-dafc-46df-8f0a-8ed1cc65040f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:05.498808 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-00526a43-dafc-46df-8f0a-8ed1cc65040f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:05.499235 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-00526a43-dafc-46df-8f0a-8ed1cc65040f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:05.535110 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-00526a43-dafc-46df-8f0a-8ed1cc65040f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049187 Mar 08 19:23:05.536028 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 481/951] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:23:05 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:05.547052 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-424f8b7b-11fc-4a48-896c-ac5da2e60498 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:05.548270 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-424f8b7b-11fc-4a48-896c-ac5da2e60498 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:05.563561 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-424f8b7b-11fc-4a48-896c-ac5da2e60498 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:05.565032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-424f8b7b-11fc-4a48-896c-ac5da2e60498 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:05.566270 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-424f8b7b-11fc-4a48-896c-ac5da2e60498 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:05.567622 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-424f8b7b-11fc-4a48-896c-ac5da2e60498 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:05.598632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-424f8b7b-11fc-4a48-896c-ac5da2e60498 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/a5c3fef3-6225-4140-ad25-36336f51c2d1" status: 200 len: 194 microversion: 2.1 time: 0.056166 Mar 08 19:23:05.599481 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 471/952] 10.222.0.75 () {58 vars in 1412 bytes} [Tue Mar 8 19:23:05 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/a5c3fef3-6225-4140-ad25-36336f51c2d1 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:07.374557 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2adfe9dc-8019-4bcb-a53d-50721b02d69c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76e3d6df-ed65-42af-839d-9226cd106783"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:23:07.378793 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2adfe9dc-8019-4bcb-a53d-50721b02d69c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:07.383025 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2adfe9dc-8019-4bcb-a53d-50721b02d69c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:07.383474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2adfe9dc-8019-4bcb-a53d-50721b02d69c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:07.384360 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2adfe9dc-8019-4bcb-a53d-50721b02d69c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:07.384730 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2adfe9dc-8019-4bcb-a53d-50721b02d69c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:08.231055 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2adfe9dc-8019-4bcb-a53d-50721b02d69c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "POST /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860147 Mar 08 19:23:08.231842 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 482/953] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:23:07 2022] POST /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments => generated 194 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:16.845717 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-699ecccb-30f4-4078-87d9-9bd5715a984c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:16.846299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-699ecccb-30f4-4078-87d9-9bd5715a984c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:16.853946 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-699ecccb-30f4-4078-87d9-9bd5715a984c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:16.854462 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-699ecccb-30f4-4078-87d9-9bd5715a984c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:16.855934 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-699ecccb-30f4-4078-87d9-9bd5715a984c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:16.855934 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-699ecccb-30f4-4078-87d9-9bd5715a984c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:16.887695 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-699ecccb-30f4-4078-87d9-9bd5715a984c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047302 Mar 08 19:23:16.888410 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 472/954] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:23:16 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:17.047130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f99d00d9-1662-4ce5-8ac6-7c1c9761f890 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:17.048354 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f99d00d9-1662-4ce5-8ac6-7c1c9761f890 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:17.060088 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f99d00d9-1662-4ce5-8ac6-7c1c9761f890 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:17.060545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f99d00d9-1662-4ce5-8ac6-7c1c9761f890 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:17.064185 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f99d00d9-1662-4ce5-8ac6-7c1c9761f890 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:17.065007 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f99d00d9-1662-4ce5-8ac6-7c1c9761f890 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:17.104210 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f99d00d9-1662-4ce5-8ac6-7c1c9761f890 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/a5c3fef3-6225-4140-ad25-36336f51c2d1" status: 200 len: 194 microversion: 2.1 time: 0.063581 Mar 08 19:23:17.105530 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 483/955] 10.222.0.75 () {58 vars in 1412 bytes} [Tue Mar 8 19:23:17 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/a5c3fef3-6225-4140-ad25-36336f51c2d1 => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:17.115595 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-71d55781-fc47-4c21-bbdc-c0ff045fba5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:17.116274 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-71d55781-fc47-4c21-bbdc-c0ff045fba5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:17.132414 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-71d55781-fc47-4c21-bbdc-c0ff045fba5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:17.133098 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-71d55781-fc47-4c21-bbdc-c0ff045fba5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:17.134623 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-71d55781-fc47-4c21-bbdc-c0ff045fba5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:17.135226 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-71d55781-fc47-4c21-bbdc-c0ff045fba5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:17.245150 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-71d55781-fc47-4c21-bbdc-c0ff045fba5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lazy-loading 'services' on Instance uuid 0acbc896-30e8-49e3-b3c7-53127e5d947e {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:23:17.550771 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-71d55781-fc47-4c21-bbdc-c0ff045fba5c tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/a5c3fef3-6225-4140-ad25-36336f51c2d1" status: 202 len: 0 microversion: 2.1 time: 0.438787 Mar 08 19:23:17.551809 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 473/956] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:23:17 2022] DELETE /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/a5c3fef3-6225-4140-ad25-36336f51c2d1 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:23:19.742969 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1c947356-7161-4619-80e7-f349682b21d3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:19.744220 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1c947356-7161-4619-80e7-f349682b21d3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:19.751626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1c947356-7161-4619-80e7-f349682b21d3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:19.752183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1c947356-7161-4619-80e7-f349682b21d3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:19.753176 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1c947356-7161-4619-80e7-f349682b21d3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:19.753823 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1c947356-7161-4619-80e7-f349682b21d3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:19.785510 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1c947356-7161-4619-80e7-f349682b21d3 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/76e3d6df-ed65-42af-839d-9226cd106783" status: 200 len: 194 microversion: 2.1 time: 0.047537 Mar 08 19:23:19.787953 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 484/957] 10.222.0.75 () {58 vars in 1412 bytes} [Tue Mar 8 19:23:19 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/76e3d6df-ed65-42af-839d-9226cd106783 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:19.796855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-728871fe-c4ff-4d4a-8c5a-5fadfa78fb1f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:19.797449 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-728871fe-c4ff-4d4a-8c5a-5fadfa78fb1f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:19.803752 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-728871fe-c4ff-4d4a-8c5a-5fadfa78fb1f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:19.804361 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-728871fe-c4ff-4d4a-8c5a-5fadfa78fb1f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:19.805135 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-728871fe-c4ff-4d4a-8c5a-5fadfa78fb1f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:19.805570 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-728871fe-c4ff-4d4a-8c5a-5fadfa78fb1f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:19.901989 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-728871fe-c4ff-4d4a-8c5a-5fadfa78fb1f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lazy-loading 'services' on Instance uuid 0acbc896-30e8-49e3-b3c7-53127e5d947e {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:23:20.145686 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-728871fe-c4ff-4d4a-8c5a-5fadfa78fb1f tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/76e3d6df-ed65-42af-839d-9226cd106783" status: 202 len: 0 microversion: 2.1 time: 0.353123 Mar 08 19:23:20.146567 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 474/958] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:23:19 2022] DELETE /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments/76e3d6df-ed65-42af-839d-9226cd106783 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:23:21.347368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ff3db0a9-0b37-44c4-8990-0510513df9e6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:21.349226 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ff3db0a9-0b37-44c4-8990-0510513df9e6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:21.355937 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff3db0a9-0b37-44c4-8990-0510513df9e6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:21.356431 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff3db0a9-0b37-44c4-8990-0510513df9e6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:21.357278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff3db0a9-0b37-44c4-8990-0510513df9e6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:21.357721 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ff3db0a9-0b37-44c4-8990-0510513df9e6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:21.390559 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ff3db0a9-0b37-44c4-8990-0510513df9e6 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047090 Mar 08 19:23:21.391139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 485/959] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:23:21 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 08 19:23:21.537246 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-04a8acd4-5ed0-461c-9de3-2c2a9207ed62 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:21.539216 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-04a8acd4-5ed0-461c-9de3-2c2a9207ed62 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:21.561210 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-04a8acd4-5ed0-461c-9de3-2c2a9207ed62 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:21.561210 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-04a8acd4-5ed0-461c-9de3-2c2a9207ed62 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:21.563359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-04a8acd4-5ed0-461c-9de3-2c2a9207ed62 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:21.563359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-04a8acd4-5ed0-461c-9de3-2c2a9207ed62 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:21.606205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-04a8acd4-5ed0-461c-9de3-2c2a9207ed62 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.081756 Mar 08 19:23:21.606795 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 475/960] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:23:21 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:23:21.693504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f2110b7e-551a-4664-a8f8-33a575f12a54 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:21.694059 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f2110b7e-551a-4664-a8f8-33a575f12a54 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:21.718270 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f2110b7e-551a-4664-a8f8-33a575f12a54 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:21.718954 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f2110b7e-551a-4664-a8f8-33a575f12a54 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:21.720640 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f2110b7e-551a-4664-a8f8-33a575f12a54 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:21.721276 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f2110b7e-551a-4664-a8f8-33a575f12a54 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:21.771015 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f2110b7e-551a-4664-a8f8-33a575f12a54 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:23:22.210172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f2110b7e-551a-4664-a8f8-33a575f12a54 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 204 len: 0 microversion: 2.1 time: 0.521709 Mar 08 19:23:22.210796 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 486/961] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:23:21 2022] DELETE /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:23:22.221702 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a19d0768-244f-4492-8245-8b13fae88d10 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:22.222565 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a19d0768-244f-4492-8245-8b13fae88d10 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:22.231283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a19d0768-244f-4492-8245-8b13fae88d10 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:22.231735 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a19d0768-244f-4492-8245-8b13fae88d10 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:22.232611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a19d0768-244f-4492-8245-8b13fae88d10 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:22.233052 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a19d0768-244f-4492-8245-8b13fae88d10 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:22.424543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a19d0768-244f-4492-8245-8b13fae88d10 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:22.436478 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a19d0768-244f-4492-8245-8b13fae88d10 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1674 microversion: 2.1 time: 0.220980 Mar 08 19:23:22.437063 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 476/962] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:22 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1674 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:23.456983 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-edda3b0b-86a8-409c-9582-eba0b2fcaf25 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:23.459286 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-edda3b0b-86a8-409c-9582-eba0b2fcaf25 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:23.471127 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-edda3b0b-86a8-409c-9582-eba0b2fcaf25 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:23.472286 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-edda3b0b-86a8-409c-9582-eba0b2fcaf25 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:23.478191 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-edda3b0b-86a8-409c-9582-eba0b2fcaf25 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:23.479295 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-edda3b0b-86a8-409c-9582-eba0b2fcaf25 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:23.652446 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-edda3b0b-86a8-409c-9582-eba0b2fcaf25 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:23.666350 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-edda3b0b-86a8-409c-9582-eba0b2fcaf25 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1674 microversion: 2.1 time: 0.209581 Mar 08 19:23:23.667665 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 487/963] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:23 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:24.686221 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-27f4b120-95ff-4af0-87b4-73a6c0448f46 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:24.687576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-27f4b120-95ff-4af0-87b4-73a6c0448f46 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:24.703641 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27f4b120-95ff-4af0-87b4-73a6c0448f46 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:24.704546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27f4b120-95ff-4af0-87b4-73a6c0448f46 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:24.705567 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27f4b120-95ff-4af0-87b4-73a6c0448f46 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:24.706216 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27f4b120-95ff-4af0-87b4-73a6c0448f46 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:25.450825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-27f4b120-95ff-4af0-87b4-73a6c0448f46 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:25.484727 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-27f4b120-95ff-4af0-87b4-73a6c0448f46 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1674 microversion: 2.1 time: 0.804456 Mar 08 19:23:25.487351 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 477/964] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:24 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1674 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:25.524241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-b7b4d6a0-7f2f-48ae-a553-ff51674a2098 req-8fe51314-eee0-4761-9259-c59a42348e3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0acbc896-30e8-49e3-b3c7-53127e5d947e", "name": "network-vif-deleted", "tag": "87c15cbd-fca3-451e-b547-9d99eaae8e90"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:23:25.533672 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-b7b4d6a0-7f2f-48ae-a553-ff51674a2098 req-8fe51314-eee0-4761-9259-c59a42348e3c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:25.534175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-b7b4d6a0-7f2f-48ae-a553-ff51674a2098 req-8fe51314-eee0-4761-9259-c59a42348e3c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:25.549050 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-b7b4d6a0-7f2f-48ae-a553-ff51674a2098 req-8fe51314-eee0-4761-9259-c59a42348e3c service nova] Creating event network-vif-deleted:87c15cbd-fca3-451e-b547-9d99eaae8e90 for instance 0acbc896-30e8-49e3-b3c7-53127e5d947e on hv-cinder-83009 Mar 08 19:23:25.556783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-b7b4d6a0-7f2f-48ae-a553-ff51674a2098 req-8fe51314-eee0-4761-9259-c59a42348e3c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037013 Mar 08 19:23:25.561145 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 478/965] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:23:25.661973 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d9161ea5-36de-4a7c-a5f2-847cdccd4d86 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Action: 'create', calling method: .version_select at 0x7f4383dec160>, body: {"keypair": {"name": "tempest-TestShelveInstance-91040459"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:23:25.704233 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-d9161ea5-36de-4a7c-a5f2-847cdccd4d86 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Getting quotas for project 0b0e10c3c47a4ead8a5fd46c50273d16. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:23:25.712967 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-d9161ea5-36de-4a7c-a5f2-847cdccd4d86 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Getting quotas for user ad4e83889107461b8b9033bdde57aa38 and project 0b0e10c3c47a4ead8a5fd46c50273d16. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:23:26.433320 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-d9161ea5-36de-4a7c-a5f2-847cdccd4d86 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Getting quotas for project 0b0e10c3c47a4ead8a5fd46c50273d16. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:23:26.438416 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-d9161ea5-36de-4a7c-a5f2-847cdccd4d86 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Getting quotas for user ad4e83889107461b8b9033bdde57aa38 and project 0b0e10c3c47a4ead8a5fd46c50273d16. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:23:26.453574 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d9161ea5-36de-4a7c-a5f2-847cdccd4d86 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2310 microversion: 2.1 time: 0.975224 Mar 08 19:23:26.454173 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 488/966] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:23:25 2022] POST /compute/v2.1/os-keypairs => generated 2310 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:26.505139 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:26.506674 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:26.514255 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:26.515051 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:26.516594 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:26.517051 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:26.552376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:26.552846 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:26.553297 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lazy-loading 'fault' on Instance uuid 0acbc896-30e8-49e3-b3c7-53127e5d947e {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:23:26.601632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b060e4c794d46009e926c8078045d8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '011362b6715747dba59bf9619c6bd65b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:26.607403 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-52dd4797-b776-4b91-a223-17e7ba822720 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 200 len: 1327 microversion: 2.1 time: 0.107731 Mar 08 19:23:26.608024 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 479/967] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:26 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 1327 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:23:27.626716 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:27.627322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:27.635278 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:27.635727 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:27.636526 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:27.636959 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:27.651904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] HTTP exception thrown: Instance 0acbc896-30e8-49e3-b3c7-53127e5d947e could not be found. Mar 08 19:23:27.653313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Returning 404 to user: Instance 0acbc896-30e8-49e3-b3c7-53127e5d947e could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:23:27.654142 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-62231ed1-7fdf-49bf-8187-b61f6f442cdb tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 404 len: 111 microversion: 2.1 time: 0.031497 Mar 08 19:23:27.654691 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 489/968] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:27 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:23:27.664732 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-740a8e7c-81dd-4edd-8c73-8317470b95c0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '.version_select at 0x7f4390044550>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:27.770676 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-740a8e7c-81dd-4edd-8c73-8317470b95c0 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714708076" status: 202 len: 0 microversion: 2.1 time: 0.111098 Mar 08 19:23:27.771372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 480/969] 10.222.0.75 () {58 vars in 1220 bytes} [Tue Mar 8 19:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1714708076 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:23:31.580668 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:31.581583 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:31.591873 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:31.592348 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:31.593119 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:31.593547 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:31.768849 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] HTTP exception thrown: Instance 0acbc896-30e8-49e3-b3c7-53127e5d947e could not be found. Mar 08 19:23:31.769445 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Returning 404 to user: Instance 0acbc896-30e8-49e3-b3c7-53127e5d947e could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:23:31.770942 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-09bf0335-9026-4480-b84e-b6d7cf8658ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 404 len: 111 microversion: 2.1 time: 0.193718 Mar 08 19:23:31.771593 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 490/970] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:23:31 2022] DELETE /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:23:31.779718 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:31.780466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: 0acbc896-30e8-49e3-b3c7-53127e5d947e] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:31.788132 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:31.788587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:31.789370 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:31.789811 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:31.805074 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] HTTP exception thrown: Instance 0acbc896-30e8-49e3-b3c7-53127e5d947e could not be found. Mar 08 19:23:31.805685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Returning 404 to user: Instance 0acbc896-30e8-49e3-b3c7-53127e5d947e could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:23:31.806909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fd8172c7-add4-4474-821f-0429b5ae7566 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e" status: 404 len: 111 microversion: 2.1 time: 0.031117 Mar 08 19:23:31.807677 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 481/971] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:31 2022] GET /compute/v2.1/servers/0acbc896-30e8-49e3-b3c7-53127e5d947e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:23:33.108037 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:33.108747 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:33.116113 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:33.116615 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:33.117378 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:33.117816 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:33.132846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] HTTP exception thrown: Instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea could not be found. Mar 08 19:23:33.133445 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Returning 404 to user: Instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:23:33.134274 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ce49d255-7c45-4a2d-8aba-7f2f08243fb7 tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "DELETE /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 404 len: 111 microversion: 2.1 time: 0.030244 Mar 08 19:23:33.134822 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 491/972] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:23:33 2022] DELETE /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:23:33.143619 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:33.144252 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] [instance: e431bba0-7d48-4fff-ace4-d5ba4a32a2ea] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:33.151175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:33.151627 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:33.152443 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:33.152892 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:33.166961 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] HTTP exception thrown: Instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea could not be found. Mar 08 19:23:33.167557 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] Returning 404 to user: Instance e431bba0-7d48-4fff-ace4-d5ba4a32a2ea could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:23:33.168429 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1b15084c-2d8c-4b0e-9ca2-54496368d4ed tempest-AttachVolumeTestJSON-1265146509 tempest-AttachVolumeTestJSON-1265146509-project] 10.222.0.75 "GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea" status: 404 len: 111 microversion: 2.1 time: 0.028902 Mar 08 19:23:33.168985 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 482/973] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:33 2022] GET /compute/v2.1/servers/e431bba0-7d48-4fff-ace4-d5ba4a32a2ea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:23:39.859259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-50219ae5-5b5c-4d47-8622-77e63bf96ecf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:39.859806 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-50219ae5-5b5c-4d47-8622-77e63bf96ecf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:39.869439 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-50219ae5-5b5c-4d47-8622-77e63bf96ecf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:39.870410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-50219ae5-5b5c-4d47-8622-77e63bf96ecf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:39.871599 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-50219ae5-5b5c-4d47-8622-77e63bf96ecf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:39.872160 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-50219ae5-5b5c-4d47-8622-77e63bf96ecf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:39.899179 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-50219ae5-5b5c-4d47-8622-77e63bf96ecf tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/ips" status: 200 len: 150 microversion: 2.1 time: 0.043754 Mar 08 19:23:39.899743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 492/974] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:23:39 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:41.639782 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7158c33b-6a9d-43cb-bbaf-aae8c23475f9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a33d5df4-e138-4002-bea7-9fafeb7ffc7b"}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:23:41.640909 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7158c33b-6a9d-43cb-bbaf-aae8c23475f9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:41.648652 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7158c33b-6a9d-43cb-bbaf-aae8c23475f9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:41.649340 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7158c33b-6a9d-43cb-bbaf-aae8c23475f9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:41.650134 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7158c33b-6a9d-43cb-bbaf-aae8c23475f9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:41.650578 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7158c33b-6a9d-43cb-bbaf-aae8c23475f9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:42.586322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7158c33b-6a9d-43cb-bbaf-aae8c23475f9 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "POST /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.951544 Mar 08 19:23:42.586998 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 483/975] 10.222.0.75 () {60 vars in 1322 bytes} [Tue Mar 8 19:23:41 2022] POST /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments => generated 194 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:23:50.333422 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-74ceb3b9-57b4-4b12-af4e-6b7fb073e9f6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:50.336153 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-74ceb3b9-57b4-4b12-af4e-6b7fb073e9f6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:50.340910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-74ceb3b9-57b4-4b12-af4e-6b7fb073e9f6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:50.341777 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-74ceb3b9-57b4-4b12-af4e-6b7fb073e9f6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:50.342666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-74ceb3b9-57b4-4b12-af4e-6b7fb073e9f6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:50.343363 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-74ceb3b9-57b4-4b12-af4e-6b7fb073e9f6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:50.663018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-74ceb3b9-57b4-4b12-af4e-6b7fb073e9f6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lazy-loading 'services' on Instance uuid 69246580-c8f3-4b73-8f8e-b957fff68f2a {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:23:50.912887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-74ceb3b9-57b4-4b12-af4e-6b7fb073e9f6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments/a33d5df4-e138-4002-bea7-9fafeb7ffc7b" status: 202 len: 0 microversion: 2.1 time: 0.584822 Mar 08 19:23:50.913547 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 493/976] 10.222.0.75 () {58 vars in 1415 bytes} [Tue Mar 8 19:23:50 2022] DELETE /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments/a33d5df4-e138-4002-bea7-9fafeb7ffc7b => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:23:50.924867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ad462fd7-d419-4d1b-b816-64e41826fa1c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:50.930346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ad462fd7-d419-4d1b-b816-64e41826fa1c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:50.934527 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ad462fd7-d419-4d1b-b816-64e41826fa1c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:50.935060 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ad462fd7-d419-4d1b-b816-64e41826fa1c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:50.935877 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ad462fd7-d419-4d1b-b816-64e41826fa1c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:50.936376 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ad462fd7-d419-4d1b-b816-64e41826fa1c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:50.975482 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ad462fd7-d419-4d1b-b816-64e41826fa1c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055643 Mar 08 19:23:50.976544 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 484/977] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:23:50 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:51.990898 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7688090d-52aa-4b5d-beca-7edaa727ad5b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:51.991988 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7688090d-52aa-4b5d-beca-7edaa727ad5b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:52.001601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7688090d-52aa-4b5d-beca-7edaa727ad5b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:52.003233 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7688090d-52aa-4b5d-beca-7edaa727ad5b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:52.004916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7688090d-52aa-4b5d-beca-7edaa727ad5b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:52.005643 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7688090d-52aa-4b5d-beca-7edaa727ad5b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:52.045638 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7688090d-52aa-4b5d-beca-7edaa727ad5b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059849 Mar 08 19:23:52.046290 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 494/978] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:23:51 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:53.063123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b7609a9f-1053-4e09-9700-eacd2ecd7768 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:53.063977 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b7609a9f-1053-4e09-9700-eacd2ecd7768 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:53.070886 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b7609a9f-1053-4e09-9700-eacd2ecd7768 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:53.071330 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b7609a9f-1053-4e09-9700-eacd2ecd7768 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:53.072163 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b7609a9f-1053-4e09-9700-eacd2ecd7768 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:53.072598 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b7609a9f-1053-4e09-9700-eacd2ecd7768 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:53.103192 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b7609a9f-1053-4e09-9700-eacd2ecd7768 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044198 Mar 08 19:23:53.103752 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 485/979] 10.222.0.75 () {58 vars in 1301 bytes} [Tue Mar 8 19:23:53 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 08 19:23:53.182783 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-708085bc-0d99-4232-b141-837adc473b90 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:53.183363 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-708085bc-0d99-4232-b141-837adc473b90 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:53.189341 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-708085bc-0d99-4232-b141-837adc473b90 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:53.190681 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-708085bc-0d99-4232-b141-837adc473b90 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:53.190858 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-708085bc-0d99-4232-b141-837adc473b90 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:53.191888 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-708085bc-0d99-4232-b141-837adc473b90 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:53.221803 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-708085bc-0d99-4232-b141-837adc473b90 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:23:53.569232 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-708085bc-0d99-4232-b141-837adc473b90 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 204 len: 0 microversion: 2.1 time: 0.390381 Mar 08 19:23:53.569845 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 495/980] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:23:53 2022] DELETE /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:23:53.586139 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5489b664-3305-4d11-bd12-2bd7eba83b94 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:53.586139 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5489b664-3305-4d11-bd12-2bd7eba83b94 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:53.591477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5489b664-3305-4d11-bd12-2bd7eba83b94 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:53.591477 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5489b664-3305-4d11-bd12-2bd7eba83b94 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:53.592293 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5489b664-3305-4d11-bd12-2bd7eba83b94 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:53.592730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5489b664-3305-4d11-bd12-2bd7eba83b94 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:53.756522 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5489b664-3305-4d11-bd12-2bd7eba83b94 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:53.765318 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5489b664-3305-4d11-bd12-2bd7eba83b94 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1681 microversion: 2.1 time: 0.189831 Mar 08 19:23:53.765897 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 486/981] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:53 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:54.591746 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-937103729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-91040459", "security_groups": [{"name": "tempest-secgroup-smoke-660178399"}], "networks": [{"uuid": "da437335-2487-47d7-93f2-2e3aab805345"}], "block_device_mapping_v2": [{"uuid": "4e89d0e1-fc0e-4a30-9b93-5badf6c7de9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:23:54.741957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.network.neutron [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] validate_networks() for [('da437335-2487-47d7-93f2-2e3aab805345', None, None, None, None, None)] {{(pid=117391) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:23:54.782740 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0a9ae253-2491-4060-b49d-def5d435a435 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:54.783352 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0a9ae253-2491-4060-b49d-def5d435a435 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:54.796579 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0a9ae253-2491-4060-b49d-def5d435a435 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:54.797038 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0a9ae253-2491-4060-b49d-def5d435a435 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:54.798412 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0a9ae253-2491-4060-b49d-def5d435a435 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:54.799045 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0a9ae253-2491-4060-b49d-def5d435a435 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:55.049717 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0a9ae253-2491-4060-b49d-def5d435a435 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:55.058476 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0a9ae253-2491-4060-b49d-def5d435a435 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1681 microversion: 2.1 time: 0.279614 Mar 08 19:23:55.059058 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 487/982] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:54 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:23:55.335921 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Flavor limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:23:55.336482 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Image limits 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:23:55.336974 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Flavor pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:23:55.337380 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Image pref 0:0:0 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:23:55.337788 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.virt.hardware [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:23:55.348473 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:55.348965 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:55.349817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:55.350258 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:55.372221 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Getting quotas for project 0b0e10c3c47a4ead8a5fd46c50273d16. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:23:55.376496 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Getting quotas for user ad4e83889107461b8b9033bdde57aa38 and project 0b0e10c3c47a4ead8a5fd46c50273d16. Resources: {'cores', 'instances', 'ram'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:23:55.472885 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Going to run 1 instances... {{(pid=117391) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:23:55.472885 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e89d0e1-fc0e-4a30-9b93-5badf6c7de9e',volume_size=None,volume_type=None)] {{(pid=117391) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:23:55.882671 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-314dc900-7e65-4536-94f3-7612c2b02b77 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.301928 Mar 08 19:23:55.883588 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 496/983] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:23:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 08 19:23:55.899748 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1a32b16f-9bdf-4ce0-a093-8dd620442889 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:55.900542 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1a32b16f-9bdf-4ce0-a093-8dd620442889 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:55.992276 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1a32b16f-9bdf-4ce0-a093-8dd620442889 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:56.003004 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1a32b16f-9bdf-4ce0-a093-8dd620442889 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1086 microversion: 2.1 time: 0.110040 Mar 08 19:23:56.004074 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 488/984] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:55 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1086 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:56.082745 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-61cfe6ef-1219-4459-8cbb-1158f747652c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:56.083528 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-61cfe6ef-1219-4459-8cbb-1158f747652c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:56.090929 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-61cfe6ef-1219-4459-8cbb-1158f747652c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:56.091477 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-61cfe6ef-1219-4459-8cbb-1158f747652c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:56.092456 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-61cfe6ef-1219-4459-8cbb-1158f747652c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:56.092974 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-61cfe6ef-1219-4459-8cbb-1158f747652c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:56.272068 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-61cfe6ef-1219-4459-8cbb-1158f747652c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:56.280967 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-61cfe6ef-1219-4459-8cbb-1158f747652c tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1681 microversion: 2.1 time: 0.204565 Mar 08 19:23:56.281561 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 497/985] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:56 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:23:56.695025 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-e042d793-aeea-4140-a0d6-039de24e9392 req-1e7a81f4-3d14-41ba-8927-24c1fb9963a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69246580-c8f3-4b73-8f8e-b957fff68f2a", "name": "network-vif-deleted", "tag": "53289e48-6128-4777-8871-ee89220f42dc"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:23:56.716298 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-e042d793-aeea-4140-a0d6-039de24e9392 req-1e7a81f4-3d14-41ba-8927-24c1fb9963a5 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:56.720425 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-e042d793-aeea-4140-a0d6-039de24e9392 req-1e7a81f4-3d14-41ba-8927-24c1fb9963a5 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:56.751705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-e042d793-aeea-4140-a0d6-039de24e9392 req-1e7a81f4-3d14-41ba-8927-24c1fb9963a5 service nova] Creating event network-vif-deleted:53289e48-6128-4777-8871-ee89220f42dc for instance 69246580-c8f3-4b73-8f8e-b957fff68f2a on hv-cinder-83009 Mar 08 19:23:56.766363 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-e042d793-aeea-4140-a0d6-039de24e9392 req-1e7a81f4-3d14-41ba-8927-24c1fb9963a5 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078463 Mar 08 19:23:56.773400 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 489/986] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:23:57.021247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f95f0782-d8df-4c55-9212-cec4b0e605e1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:57.021860 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f95f0782-d8df-4c55-9212-cec4b0e605e1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:57.106018 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f95f0782-d8df-4c55-9212-cec4b0e605e1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:57.114369 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f95f0782-d8df-4c55-9212-cec4b0e605e1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1086 microversion: 2.1 time: 0.097894 Mar 08 19:23:57.115454 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 498/987] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:57 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1086 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:57.302230 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:57.303939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:57.315893 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:57.317777 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:57.318624 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:57.319374 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:57.366154 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:57.367230 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:57.367905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lazy-loading 'fault' on Instance uuid 69246580-c8f3-4b73-8f8e-b957fff68f2a {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:23:57.424979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9e2fd821cc84d778f2825c654f29e3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff78af332934469ba0ee399835378e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:57.446203 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-27b287b0-84e4-4911-9ffb-42bab56cc2a6 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 200 len: 1330 microversion: 2.1 time: 0.149152 Mar 08 19:23:57.446427 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 490/988] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:57 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 1330 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:58.133543 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a2d9afd3-1cf1-40a0-afaf-6989e2937aaa tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:58.134088 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a2d9afd3-1cf1-40a0-afaf-6989e2937aaa tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:58.143442 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a2d9afd3-1cf1-40a0-afaf-6989e2937aaa tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:58.144269 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a2d9afd3-1cf1-40a0-afaf-6989e2937aaa tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:58.145131 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a2d9afd3-1cf1-40a0-afaf-6989e2937aaa tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:58.145570 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a2d9afd3-1cf1-40a0-afaf-6989e2937aaa tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:58.230604 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a2d9afd3-1cf1-40a0-afaf-6989e2937aaa tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:58.241171 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a2d9afd3-1cf1-40a0-afaf-6989e2937aaa tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1184 microversion: 2.1 time: 0.113436 Mar 08 19:23:58.241817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 499/989] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:58 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1184 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:23:58.464878 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:58.465467 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:58.474542 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:58.475365 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:58.476390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:58.476977 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:58.492493 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 69246580-c8f3-4b73-8f8e-b957fff68f2a could not be found. Mar 08 19:23:58.493104 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 69246580-c8f3-4b73-8f8e-b957fff68f2a could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:23:58.494386 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-060d3a48-1074-4623-830f-b7f6a4ed1545 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 404 len: 111 microversion: 2.1 time: 0.033237 Mar 08 19:23:58.494888 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 491/990] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:58 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:23:58.508056 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-278ec007-233c-4524-862c-44fd79813c84 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '.version_select at 0x7f4383eb35e0>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:58.644721 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-278ec007-233c-4524-862c-44fd79813c84 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-868129316" status: 202 len: 0 microversion: 2.1 time: 0.144373 Mar 08 19:23:58.645515 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 500/991] 10.222.0.75 () {58 vars in 1217 bytes} [Tue Mar 8 19:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-868129316 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:23:59.262717 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ca538506-ca59-4d3e-9ea0-4a8f8e6294c1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:59.263547 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ca538506-ca59-4d3e-9ea0-4a8f8e6294c1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:59.275636 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ca538506-ca59-4d3e-9ea0-4a8f8e6294c1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:59.276129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ca538506-ca59-4d3e-9ea0-4a8f8e6294c1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:59.277346 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ca538506-ca59-4d3e-9ea0-4a8f8e6294c1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:59.278103 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ca538506-ca59-4d3e-9ea0-4a8f8e6294c1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:59.408206 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ca538506-ca59-4d3e-9ea0-4a8f8e6294c1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:23:59.430187 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ca538506-ca59-4d3e-9ea0-4a8f8e6294c1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1202 microversion: 2.1 time: 0.169998 Mar 08 19:23:59.440524 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 492/992] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:23:59 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1202 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:59.504838 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-48346641-5c1a-4fdd-b86a-889e8cb7bb14 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:59.509981 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-48346641-5c1a-4fdd-b86a-889e8cb7bb14 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:59.516172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48346641-5c1a-4fdd-b86a-889e8cb7bb14 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:59.516879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48346641-5c1a-4fdd-b86a-889e8cb7bb14 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:59.517864 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48346641-5c1a-4fdd-b86a-889e8cb7bb14 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:59.518302 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-48346641-5c1a-4fdd-b86a-889e8cb7bb14 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:59.560188 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-48346641-5c1a-4fdd-b86a-889e8cb7bb14 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060863 Mar 08 19:23:59.561226 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 501/993] 10.222.0.75 () {60 vars in 1342 bytes} [Tue Mar 8 19:23:59 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:23:59.654261 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fc10e1ea-b3cd-4588-95ba-19a9b5431ca9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:23:59.655100 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fc10e1ea-b3cd-4588-95ba-19a9b5431ca9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:23:59.663271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fc10e1ea-b3cd-4588-95ba-19a9b5431ca9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:59.663976 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fc10e1ea-b3cd-4588-95ba-19a9b5431ca9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:59.665231 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fc10e1ea-b3cd-4588-95ba-19a9b5431ca9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:23:59.665667 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fc10e1ea-b3cd-4588-95ba-19a9b5431ca9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:23:59.707300 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fc10e1ea-b3cd-4588-95ba-19a9b5431ca9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Going to try to terminate instance {{(pid=117390) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:24:00.110657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fc10e1ea-b3cd-4588-95ba-19a9b5431ca9 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 204 len: 0 microversion: 2.20 time: 0.463137 Mar 08 19:24:00.115697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 493/994] 10.222.0.75 () {60 vars in 1279 bytes} [Tue Mar 8 19:23:59 2022] DELETE /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 19:24:00.125344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:00.125344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:00.132870 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:00.133320 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:00.135377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:00.136284 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:00.400762 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:00.419030 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:00.421685 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:00.423494 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7a23182b-554f-489b-9d3c-c71c092eb26c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.303813 Mar 08 19:24:00.424141 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 502/995] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:24:00 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:24:00.458712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-11190b0a-6208-4641-93da-d49efeb79855 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:00.458712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-11190b0a-6208-4641-93da-d49efeb79855 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:00.466449 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-11190b0a-6208-4641-93da-d49efeb79855 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:00.466449 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-11190b0a-6208-4641-93da-d49efeb79855 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:00.466449 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-11190b0a-6208-4641-93da-d49efeb79855 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:00.466449 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-11190b0a-6208-4641-93da-d49efeb79855 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:00.793546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-11190b0a-6208-4641-93da-d49efeb79855 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:00.804473 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-11190b0a-6208-4641-93da-d49efeb79855 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.358230 Mar 08 19:24:00.805171 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 494/996] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:00 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:01.303661 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:01.305904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:01.321952 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.326630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:01.326630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.326630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:01.344646 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 69246580-c8f3-4b73-8f8e-b957fff68f2a could not be found. Mar 08 19:24:01.346259 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 69246580-c8f3-4b73-8f8e-b957fff68f2a could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:01.348879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1742dc5c-bb95-4ade-bcfe-8e2a2e44b1af tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 404 len: 111 microversion: 2.1 time: 0.050474 Mar 08 19:24:01.350130 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 503/997] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:24:01 2022] DELETE /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:24:01.366005 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:01.366802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 69246580-c8f3-4b73-8f8e-b957fff68f2a] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:01.375818 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.377419 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:01.381637 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.382102 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:01.404102 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-da0e367c-6d09-47d9-89d9-530975b55d95 req-12e07ee8-bf59-4d05-bd3a-54f7ffcde0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015a3ea6-135a-4574-a5a1-e7ebeb9a7a61", "tag": "55a93dab-2682-44a0-9a81-5794b54922a7"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:24:01.426393 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 69246580-c8f3-4b73-8f8e-b957fff68f2a could not be found. Mar 08 19:24:01.427368 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 69246580-c8f3-4b73-8f8e-b957fff68f2a could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:01.428934 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-66ba1575-2577-42d5-8acb-0992f6d79645 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a" status: 404 len: 111 microversion: 2.1 time: 0.072952 Mar 08 19:24:01.430229 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 495/998] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:01 2022] GET /compute/v2.1/servers/69246580-c8f3-4b73-8f8e-b957fff68f2a => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:24:01.448745 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:01.448745 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:01.455717 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.456372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:01.458262 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.458739 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:01.466028 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-da0e367c-6d09-47d9-89d9-530975b55d95 req-12e07ee8-bf59-4d05-bd3a-54f7ffcde0e6 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.467548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-da0e367c-6d09-47d9-89d9-530975b55d95 req-12e07ee8-bf59-4d05-bd3a-54f7ffcde0e6 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:01.524874 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-da0e367c-6d09-47d9-89d9-530975b55d95 req-12e07ee8-bf59-4d05-bd3a-54f7ffcde0e6 service nova] Creating event network-changed:55a93dab-2682-44a0-9a81-5794b54922a7 for instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 on hv-cinder-83009 Mar 08 19:24:01.530644 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-da0e367c-6d09-47d9-89d9-530975b55d95 req-12e07ee8-bf59-4d05-bd3a-54f7ffcde0e6 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130651 Mar 08 19:24:01.531350 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 504/999] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:24:01.820549 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:01.832194 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:01.833067 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-41744d8b-d7d9-4a70-b4c1-ba9da0fc9f31 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:01.833725 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-41744d8b-d7d9-4a70-b4c1-ba9da0fc9f31 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:01.835952 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:01.837454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-dfeeb047-75a9-4615-8256-385521f95aa7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.398011 Mar 08 19:24:01.838057 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 496/1000] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:24:01 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:24:01.840106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-41744d8b-d7d9-4a70-b4c1-ba9da0fc9f31 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.840560 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-41744d8b-d7d9-4a70-b4c1-ba9da0fc9f31 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:01.841387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-41744d8b-d7d9-4a70-b4c1-ba9da0fc9f31 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:01.841945 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-41744d8b-d7d9-4a70-b4c1-ba9da0fc9f31 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.280907 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-41744d8b-d7d9-4a70-b4c1-ba9da0fc9f31 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:02.288998 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-41744d8b-d7d9-4a70-b4c1-ba9da0fc9f31 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.460858 Mar 08 19:24:02.289937 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 505/1001] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:01 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:24:02.755851 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:02.756407 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:02.762626 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.763083 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.763846 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.764316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.781181 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 9c138706-751b-40a6-9cd3-9200e0dc36fd could not be found. Mar 08 19:24:02.781683 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 9c138706-751b-40a6-9cd3-9200e0dc36fd could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:02.782780 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-cf8a4d37-f66c-4bea-af8f-491fed5bd8d0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 404 len: 111 microversion: 2.1 time: 0.032173 Mar 08 19:24:02.783351 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 497/1002] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:24:02 2022] DELETE /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:24:02.792684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:02.794630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 9c138706-751b-40a6-9cd3-9200e0dc36fd] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:02.811275 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.811821 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.812889 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.813412 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.831254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 9c138706-751b-40a6-9cd3-9200e0dc36fd could not be found. Mar 08 19:24:02.838017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 9c138706-751b-40a6-9cd3-9200e0dc36fd could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:02.838017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-55a4ef4e-5388-49a2-af86-99a02e605226 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd" status: 404 len: 111 microversion: 2.1 time: 0.045115 Mar 08 19:24:02.838017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 506/1003] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:02 2022] GET /compute/v2.1/servers/9c138706-751b-40a6-9cd3-9200e0dc36fd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:24:02.843814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:02.845155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:02.852977 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.853716 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.855359 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.856057 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.860827 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:02.861726 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:02.868804 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.869788 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.870290 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.870741 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.872051 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 8644e465-6137-4694-97d5-5348bc14e92b could not be found. Mar 08 19:24:02.872863 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 8644e465-6137-4694-97d5-5348bc14e92b could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:02.874054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a5128b68-9d4d-4fc1-82af-cac26bf3ce3b tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 404 len: 111 microversion: 2.1 time: 0.034770 Mar 08 19:24:02.877654 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 498/1004] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:24:02 2022] DELETE /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:24:02.883422 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:02.884176 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 8644e465-6137-4694-97d5-5348bc14e92b] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:02.895774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.896254 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.897937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:02.897937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:02.914464 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 8644e465-6137-4694-97d5-5348bc14e92b could not be found. Mar 08 19:24:02.915397 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 8644e465-6137-4694-97d5-5348bc14e92b could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:02.916267 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-49ad4b12-f8db-43ad-ba91-b90a349dd6b5 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b" status: 404 len: 111 microversion: 2.1 time: 0.036945 Mar 08 19:24:02.916828 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 499/1005] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:02 2022] GET /compute/v2.1/servers/8644e465-6137-4694-97d5-5348bc14e92b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:24:03.229597 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:03.244486 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:03.248116 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:03.250797 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-afeb86d6-8eea-46dc-9167-0a8f5cb2904e tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1721 microversion: 2.20 time: 0.395131 Mar 08 19:24:03.251847 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 507/1006] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:24:02 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1721 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:24:03.309223 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c09c02ba-ffc9-4c95-9b0b-01054293c4f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:03.309223 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c09c02ba-ffc9-4c95-9b0b-01054293c4f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:03.320079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c09c02ba-ffc9-4c95-9b0b-01054293c4f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:03.320079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c09c02ba-ffc9-4c95-9b0b-01054293c4f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:03.320079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c09c02ba-ffc9-4c95-9b0b-01054293c4f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:03.320079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c09c02ba-ffc9-4c95-9b0b-01054293c4f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:03.736160 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c09c02ba-ffc9-4c95-9b0b-01054293c4f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:03.756030 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c09c02ba-ffc9-4c95-9b0b-01054293c4f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.451498 Mar 08 19:24:03.757223 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 500/1007] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:03 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:03.919565 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-ac5dd3d8-f2a3-41c4-bb5b-fcefcb947aec req-798d00cd-7b19-494e-976c-53cfa2a4344c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fb629d0-2eab-412c-8995-f16c1538c828", "name": "network-vif-deleted", "tag": "2eb86a7d-edd4-4947-9ef9-4da4449b0e1f"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:24:03.936402 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ac5dd3d8-f2a3-41c4-bb5b-fcefcb947aec req-798d00cd-7b19-494e-976c-53cfa2a4344c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:03.936402 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ac5dd3d8-f2a3-41c4-bb5b-fcefcb947aec req-798d00cd-7b19-494e-976c-53cfa2a4344c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:03.946419 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-ac5dd3d8-f2a3-41c4-bb5b-fcefcb947aec req-798d00cd-7b19-494e-976c-53cfa2a4344c service nova] Creating event network-vif-deleted:2eb86a7d-edd4-4947-9ef9-4da4449b0e1f for instance 2fb629d0-2eab-412c-8995-f16c1538c828 on hv-cinder-83009 Mar 08 19:24:03.952621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-ac5dd3d8-f2a3-41c4-bb5b-fcefcb947aec req-798d00cd-7b19-494e-976c-53cfa2a4344c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046385 Mar 08 19:24:03.953625 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 508/1008] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:24:04.256786 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:04.258088 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:04.264431 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.270534 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:04.270534 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.270534 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:04.276934 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:04.278101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:04.283848 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 could not be found. Mar 08 19:24:04.284696 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:04.286032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e4ffba80-cb57-4503-ba56-8d28cfdf8585 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "DELETE /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 404 len: 111 microversion: 2.1 time: 0.036041 Mar 08 19:24:04.287162 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 501/1009] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:24:04 2022] DELETE /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:24:04.296522 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:04.297596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] [instance: 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:04.302712 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.303171 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:04.303982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.304420 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:04.308205 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.308902 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:04.309851 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.310446 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:04.328155 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] HTTP exception thrown: Instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 could not be found. Mar 08 19:24:04.329309 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] Returning 404 to user: Instance 1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:04.330953 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7cd64a80-e311-462e-8329-8c9a8db570a0 tempest-AttachVolumeNegativeTest-1009610370 tempest-AttachVolumeNegativeTest-1009610370-project] 10.222.0.75 "GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873" status: 404 len: 111 microversion: 2.1 time: 0.038486 Mar 08 19:24:04.332685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 502/1010] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:04 2022] GET /compute/v2.1/servers/1d780bbf-4e05-4ac6-8b04-8e55b2b8b873 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:24:04.345391 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.346258 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:04.346882 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lazy-loading 'fault' on Instance uuid 2fb629d0-2eab-412c-8995-f16c1538c828 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:24:04.429310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:04.438635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:04.445781 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86324e490e1041088722ab5fc5df4e91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efdd81b216bc4091b41a1aec0610c6ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:04.452670 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-32471ec5-5929-4c41-bab5-d8c2393909f0 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 200 len: 1370 microversion: 2.20 time: 0.181023 Mar 08 19:24:04.453572 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 509/1011] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:24:04 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 08 19:24:04.783562 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fea31b3e-bd17-4e0a-9f1e-28d6fccdb512 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:04.785269 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fea31b3e-bd17-4e0a-9f1e-28d6fccdb512 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:04.793962 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fea31b3e-bd17-4e0a-9f1e-28d6fccdb512 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.794761 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fea31b3e-bd17-4e0a-9f1e-28d6fccdb512 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:04.795572 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fea31b3e-bd17-4e0a-9f1e-28d6fccdb512 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:04.796048 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fea31b3e-bd17-4e0a-9f1e-28d6fccdb512 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:05.071180 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fea31b3e-bd17-4e0a-9f1e-28d6fccdb512 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:05.080147 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fea31b3e-bd17-4e0a-9f1e-28d6fccdb512 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.301106 Mar 08 19:24:05.081899 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 503/1012] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:04 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:24:05.474639 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:05.475434 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:05.485008 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:05.485634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:05.486441 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:05.486971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:05.506457 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] HTTP exception thrown: Instance 2fb629d0-2eab-412c-8995-f16c1538c828 could not be found. Mar 08 19:24:05.506457 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Returning 404 to user: Instance 2fb629d0-2eab-412c-8995-f16c1538c828 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:05.506929 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c44f06d6-7c67-4a2e-a204-ceefdb8401c7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 404 len: 111 microversion: 2.20 time: 0.037711 Mar 08 19:24:05.507503 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 510/1013] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:24:05 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:24:05.516836 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f2559dab-765b-4fc0-a842-121a6ff0eae7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '.version_select at 0x7f4390044a60>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:05.645913 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f2559dab-765b-4fc0-a842-121a6ff0eae7 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-501778886" status: 204 len: 0 microversion: 2.20 time: 0.131487 Mar 08 19:24:05.647730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 504/1014] 10.222.0.75 () {60 vars in 1258 bytes} [Tue Mar 8 19:24:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-501778886 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 08 19:24:06.099131 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1d01957f-1ce6-4942-ae1b-d381267a0d08 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:06.099669 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1d01957f-1ce6-4942-ae1b-d381267a0d08 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:06.114755 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1d01957f-1ce6-4942-ae1b-d381267a0d08 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:06.115528 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1d01957f-1ce6-4942-ae1b-d381267a0d08 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:06.116583 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1d01957f-1ce6-4942-ae1b-d381267a0d08 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:06.117199 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1d01957f-1ce6-4942-ae1b-d381267a0d08 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:06.463448 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1d01957f-1ce6-4942-ae1b-d381267a0d08 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:06.476009 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1d01957f-1ce6-4942-ae1b-d381267a0d08 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.380900 Mar 08 19:24:06.477433 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 511/1015] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:06 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:07.500970 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d312b974-afc4-4fe3-884b-82239e55b3f6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:07.502862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d312b974-afc4-4fe3-884b-82239e55b3f6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:07.519348 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d312b974-afc4-4fe3-884b-82239e55b3f6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:07.521273 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d312b974-afc4-4fe3-884b-82239e55b3f6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:07.526321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d312b974-afc4-4fe3-884b-82239e55b3f6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:07.526321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d312b974-afc4-4fe3-884b-82239e55b3f6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:07.831987 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d312b974-afc4-4fe3-884b-82239e55b3f6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:07.840243 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d312b974-afc4-4fe3-884b-82239e55b3f6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.347512 Mar 08 19:24:07.840821 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 505/1016] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:07 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:08.333248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:08.333815 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:08.340872 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:08.342428 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:08.342428 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:08.343237 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:08.359334 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] HTTP exception thrown: Instance 2fb629d0-2eab-412c-8995-f16c1538c828 could not be found. Mar 08 19:24:08.359982 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Returning 404 to user: Instance 2fb629d0-2eab-412c-8995-f16c1538c828 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:08.360784 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a46acfdb-0b50-4d8e-9c5d-9ed304ca7cba tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "DELETE /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 404 len: 111 microversion: 2.20 time: 0.031689 Mar 08 19:24:08.361746 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 512/1017] 10.222.0.75 () {60 vars in 1279 bytes} [Tue Mar 8 19:24:08 2022] DELETE /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:24:08.377614 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:08.378855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: 2fb629d0-2eab-412c-8995-f16c1538c828] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:08.386239 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:08.386697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:08.387484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:08.387952 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:08.403308 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] HTTP exception thrown: Instance 2fb629d0-2eab-412c-8995-f16c1538c828 could not be found. Mar 08 19:24:08.403894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Returning 404 to user: Instance 2fb629d0-2eab-412c-8995-f16c1538c828 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:08.404872 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-261c589d-867d-4b83-a246-a32afcd275eb tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828" status: 404 len: 111 microversion: 2.20 time: 0.036629 Mar 08 19:24:08.405593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 506/1018] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:24:08 2022] GET /compute/v2.1/servers/2fb629d0-2eab-412c-8995-f16c1538c828 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:24:08.860572 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b6cf62d0-43a5-44ca-b81b-e5d2aa1fde6f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:08.861535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b6cf62d0-43a5-44ca-b81b-e5d2aa1fde6f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:08.871666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6cf62d0-43a5-44ca-b81b-e5d2aa1fde6f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:08.872666 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6cf62d0-43a5-44ca-b81b-e5d2aa1fde6f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:08.874017 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6cf62d0-43a5-44ca-b81b-e5d2aa1fde6f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:08.875086 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6cf62d0-43a5-44ca-b81b-e5d2aa1fde6f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:09.090349 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b6cf62d0-43a5-44ca-b81b-e5d2aa1fde6f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:09.117782 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b6cf62d0-43a5-44ca-b81b-e5d2aa1fde6f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.254880 Mar 08 19:24:09.117782 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 513/1019] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:08 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:09.760874 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:09.762345 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:09.770724 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:09.771172 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:09.772401 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:09.772980 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:09.794575 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] HTTP exception thrown: Instance c1d4ea86-f489-4d6d-995e-1999c95b744d could not be found. Mar 08 19:24:09.796379 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Returning 404 to user: Instance c1d4ea86-f489-4d6d-995e-1999c95b744d could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:09.797228 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-493192e6-7633-46fc-83dd-eed54b0eec0c tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "DELETE /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 404 len: 111 microversion: 2.20 time: 0.040211 Mar 08 19:24:09.797795 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 507/1020] 10.222.0.75 () {60 vars in 1279 bytes} [Tue Mar 8 19:24:09 2022] DELETE /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 08 19:24:09.811096 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:09.811717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] [instance: c1d4ea86-f489-4d6d-995e-1999c95b744d] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:09.821289 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:09.822016 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:09.823312 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:09.824029 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:09.849084 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] HTTP exception thrown: Instance c1d4ea86-f489-4d6d-995e-1999c95b744d could not be found. Mar 08 19:24:09.849657 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] Returning 404 to user: Instance c1d4ea86-f489-4d6d-995e-1999c95b744d could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:24:09.850510 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-73a94c4b-6a5f-46c4-ae7b-1d8ece17cbd8 tempest-AttachVolumeShelveTestJSON-1191894444 tempest-AttachVolumeShelveTestJSON-1191894444-project] 10.222.0.75 "GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d" status: 404 len: 111 microversion: 2.20 time: 0.046717 Mar 08 19:24:09.851054 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 514/1021] 10.222.0.75 () {60 vars in 1276 bytes} [Tue Mar 8 19:24:09 2022] GET /compute/v2.1/servers/c1d4ea86-f489-4d6d-995e-1999c95b744d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 08 19:24:10.136175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-30385eef-c079-4091-8722-fae685d5fee9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:10.136832 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-30385eef-c079-4091-8722-fae685d5fee9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:10.146134 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-30385eef-c079-4091-8722-fae685d5fee9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:10.151426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-30385eef-c079-4091-8722-fae685d5fee9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:10.151426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-30385eef-c079-4091-8722-fae685d5fee9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:10.151426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-30385eef-c079-4091-8722-fae685d5fee9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:10.334767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-30385eef-c079-4091-8722-fae685d5fee9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:10.350121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-30385eef-c079-4091-8722-fae685d5fee9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.223122 Mar 08 19:24:10.350714 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 508/1022] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:10 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:11.369333 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-39b9f1d9-c78f-482d-930e-6bf4607dc2dd tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:11.369333 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-39b9f1d9-c78f-482d-930e-6bf4607dc2dd tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:11.380559 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-39b9f1d9-c78f-482d-930e-6bf4607dc2dd tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:11.381622 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-39b9f1d9-c78f-482d-930e-6bf4607dc2dd tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:11.388423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-39b9f1d9-c78f-482d-930e-6bf4607dc2dd tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:11.388423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-39b9f1d9-c78f-482d-930e-6bf4607dc2dd tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:11.665075 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-39b9f1d9-c78f-482d-930e-6bf4607dc2dd tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:11.673767 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-39b9f1d9-c78f-482d-930e-6bf4607dc2dd tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.310894 Mar 08 19:24:11.674347 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 515/1023] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:11 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:12.704503 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3a20fc07-1c53-4efe-ac92-08ea5bc46033 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:12.706532 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3a20fc07-1c53-4efe-ac92-08ea5bc46033 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:12.717364 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3a20fc07-1c53-4efe-ac92-08ea5bc46033 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:12.718390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3a20fc07-1c53-4efe-ac92-08ea5bc46033 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:12.721404 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3a20fc07-1c53-4efe-ac92-08ea5bc46033 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:12.723447 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3a20fc07-1c53-4efe-ac92-08ea5bc46033 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:13.017316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3a20fc07-1c53-4efe-ac92-08ea5bc46033 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:13.028049 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3a20fc07-1c53-4efe-ac92-08ea5bc46033 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.331993 Mar 08 19:24:13.039884 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 509/1024] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:12 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:13.561971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-b3ff6e53-13e0-4f6f-814c-e2108ddbaed4 req-1a969dca-7e44-4e27-b3e7-6034a8be969e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015a3ea6-135a-4574-a5a1-e7ebeb9a7a61", "name": "network-vif-plugged", "status": "completed", "tag": "55a93dab-2682-44a0-9a81-5794b54922a7"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:24:13.579143 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-b3ff6e53-13e0-4f6f-814c-e2108ddbaed4 req-1a969dca-7e44-4e27-b3e7-6034a8be969e service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:13.579497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-b3ff6e53-13e0-4f6f-814c-e2108ddbaed4 req-1a969dca-7e44-4e27-b3e7-6034a8be969e service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:13.599442 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-b3ff6e53-13e0-4f6f-814c-e2108ddbaed4 req-1a969dca-7e44-4e27-b3e7-6034a8be969e service nova] Creating event network-vif-plugged:55a93dab-2682-44a0-9a81-5794b54922a7 for instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 on hv-cinder-83009 Mar 08 19:24:13.609261 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-b3ff6e53-13e0-4f6f-814c-e2108ddbaed4 req-1a969dca-7e44-4e27-b3e7-6034a8be969e service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052511 Mar 08 19:24:13.610801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 516/1025] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:24:14.060007 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b8aa6e27-dfc3-469b-bced-aeed7918a388 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:14.066547 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b8aa6e27-dfc3-469b-bced-aeed7918a388 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:14.081568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8aa6e27-dfc3-469b-bced-aeed7918a388 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:14.081568 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8aa6e27-dfc3-469b-bced-aeed7918a388 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:14.083434 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8aa6e27-dfc3-469b-bced-aeed7918a388 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:14.084081 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8aa6e27-dfc3-469b-bced-aeed7918a388 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:14.499327 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b8aa6e27-dfc3-469b-bced-aeed7918a388 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:14.509272 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b8aa6e27-dfc3-469b-bced-aeed7918a388 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.461730 Mar 08 19:24:14.509856 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 510/1026] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:14 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:15.536814 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c7042e72-1129-45fa-906d-3a62788d5051 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:15.538692 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c7042e72-1129-45fa-906d-3a62788d5051 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:15.548784 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c7042e72-1129-45fa-906d-3a62788d5051 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:15.550703 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c7042e72-1129-45fa-906d-3a62788d5051 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:15.558104 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c7042e72-1129-45fa-906d-3a62788d5051 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:15.558104 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c7042e72-1129-45fa-906d-3a62788d5051 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:15.751179 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c7042e72-1129-45fa-906d-3a62788d5051 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:15.762571 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c7042e72-1129-45fa-906d-3a62788d5051 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1257 microversion: 2.1 time: 0.231060 Mar 08 19:24:15.763604 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 517/1027] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:15 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1257 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:16.780441 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-45f25f02-e821-4c2a-bad6-f12ad8956aea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:16.781326 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-45f25f02-e821-4c2a-bad6-f12ad8956aea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:16.790344 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-45f25f02-e821-4c2a-bad6-f12ad8956aea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:16.790808 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-45f25f02-e821-4c2a-bad6-f12ad8956aea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:16.791591 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-45f25f02-e821-4c2a-bad6-f12ad8956aea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:16.792065 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-45f25f02-e821-4c2a-bad6-f12ad8956aea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:16.988774 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-45f25f02-e821-4c2a-bad6-f12ad8956aea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:16.996914 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-45f25f02-e821-4c2a-bad6-f12ad8956aea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1441 microversion: 2.1 time: 0.220279 Mar 08 19:24:16.997495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 511/1028] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:16 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1441 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:17.018016 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f3d1e695-b872-499f-ace2-b5cb60079da9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:24:17.019439 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f3d1e695-b872-499f-ace2-b5cb60079da9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:24:17.026377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f3d1e695-b872-499f-ace2-b5cb60079da9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:17.026829 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f3d1e695-b872-499f-ace2-b5cb60079da9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:17.027630 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f3d1e695-b872-499f-ace2-b5cb60079da9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:17.028101 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f3d1e695-b872-499f-ace2-b5cb60079da9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:17.205199 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f3d1e695-b872-499f-ace2-b5cb60079da9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:24:17.215818 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f3d1e695-b872-499f-ace2-b5cb60079da9 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1441 microversion: 2.1 time: 0.202251 Mar 08 19:24:17.218395 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 518/1029] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:24:17 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1441 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:24:20.993180 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-513461db-29f7-46d3-a62c-6f53361a58f6 req-cc99173d-7d37-41ff-92aa-8fa338c78dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015a3ea6-135a-4574-a5a1-e7ebeb9a7a61", "tag": "55a93dab-2682-44a0-9a81-5794b54922a7"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:24:21.004418 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-513461db-29f7-46d3-a62c-6f53361a58f6 req-cc99173d-7d37-41ff-92aa-8fa338c78dff service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:24:21.004868 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-513461db-29f7-46d3-a62c-6f53361a58f6 req-cc99173d-7d37-41ff-92aa-8fa338c78dff service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:24:21.017271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-513461db-29f7-46d3-a62c-6f53361a58f6 req-cc99173d-7d37-41ff-92aa-8fa338c78dff service nova] Creating event network-changed:55a93dab-2682-44a0-9a81-5794b54922a7 for instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 on hv-cinder-83009 Mar 08 19:24:21.022539 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-513461db-29f7-46d3-a62c-6f53361a58f6 req-cc99173d-7d37-41ff-92aa-8fa338c78dff service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293021 Mar 08 19:24:21.023566 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 512/1030] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:25:35.851564 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:25:35.852422 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:25:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:26:44.629188 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:26:44.629844 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:27:03.197953 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:27:03.198675 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:27:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:27:11.656831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:27:11.657427 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:27:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:27:17.329311 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:27:17.329848 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:27:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:27:38.719748 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3536b6dc-0d80-4f52-a40f-181618486b7c] AMQP server on 10.222.0.75:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Mar 08 19:27:38.724047 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fb529df6-c324-4789-a897-eec4ffe32a4d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:27:38.724586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fb529df6-c324-4789-a897-eec4ffe32a4d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:38.731063 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb529df6-c324-4789-a897-eec4ffe32a4d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:38.731520 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb529df6-c324-4789-a897-eec4ffe32a4d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:38.732316 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb529df6-c324-4789-a897-eec4ffe32a4d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:38.732763 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fb529df6-c324-4789-a897-eec4ffe32a4d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:38.755157 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-fb529df6-c324-4789-a897-eec4ffe32a4d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lazy-loading 'flavor' on Instance uuid 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:27:39.041980 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fb529df6-c324-4789-a897-eec4ffe32a4d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "POST /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61/action" status: 202 len: 0 microversion: 2.1 time: 0.323777 Mar 08 19:27:39.042493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 519/1031] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:27:38 2022] POST /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:27:39.049465 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9b499291-787a-4b22-92fa-c6cbead36a8e] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 19:27:39.053685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3bc96946-c443-40b9-a0a7-009f6fb257b8 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:39.056487 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3bc96946-c443-40b9-a0a7-009f6fb257b8 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:39.061105 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3bc96946-c443-40b9-a0a7-009f6fb257b8 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:39.061559 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3bc96946-c443-40b9-a0a7-009f6fb257b8 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:39.062329 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3bc96946-c443-40b9-a0a7-009f6fb257b8 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:39.062770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3bc96946-c443-40b9-a0a7-009f6fb257b8 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:39.201442 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3bc96946-c443-40b9-a0a7-009f6fb257b8 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:39.208993 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3bc96946-c443-40b9-a0a7-009f6fb257b8 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.161788 Mar 08 19:27:39.209551 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 513/1032] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:39 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:27:40.228472 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-bab3cf88-d01c-4366-86dd-4a4089752bc7 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:40.229131 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-bab3cf88-d01c-4366-86dd-4a4089752bc7 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:40.237009 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bab3cf88-d01c-4366-86dd-4a4089752bc7 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:40.237497 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bab3cf88-d01c-4366-86dd-4a4089752bc7 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:40.238286 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bab3cf88-d01c-4366-86dd-4a4089752bc7 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:40.238725 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-bab3cf88-d01c-4366-86dd-4a4089752bc7 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:40.242372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] [3536b6dc-0d80-4f52-a40f-181618486b7c] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54092. Mar 08 19:27:40.378417 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-bab3cf88-d01c-4366-86dd-4a4089752bc7 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:40.385915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-bab3cf88-d01c-4366-86dd-4a4089752bc7 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.162781 Mar 08 19:27:40.386474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 520/1033] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:40 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:41.403032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-59fa9967-329f-43bb-aba5-62943a6c2c89 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:41.403648 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-59fa9967-329f-43bb-aba5-62943a6c2c89 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:41.412639 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-59fa9967-329f-43bb-aba5-62943a6c2c89 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:41.421829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-59fa9967-329f-43bb-aba5-62943a6c2c89 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:41.421829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-59fa9967-329f-43bb-aba5-62943a6c2c89 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:41.421829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-59fa9967-329f-43bb-aba5-62943a6c2c89 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:41.421829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] [9b499291-787a-4b22-92fa-c6cbead36a8e] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54096. Mar 08 19:27:41.575088 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-59fa9967-329f-43bb-aba5-62943a6c2c89 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:41.583108 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-59fa9967-329f-43bb-aba5-62943a6c2c89 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.183936 Mar 08 19:27:41.583673 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 514/1034] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:41 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:42.600351 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-545a6c16-4e1f-41c8-b497-937e55b05b68 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:42.600965 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-545a6c16-4e1f-41c8-b497-937e55b05b68 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:42.607218 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-545a6c16-4e1f-41c8-b497-937e55b05b68 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:42.607667 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-545a6c16-4e1f-41c8-b497-937e55b05b68 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:42.608454 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-545a6c16-4e1f-41c8-b497-937e55b05b68 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:42.608891 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-545a6c16-4e1f-41c8-b497-937e55b05b68 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:42.750026 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-545a6c16-4e1f-41c8-b497-937e55b05b68 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:42.758453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-545a6c16-4e1f-41c8-b497-937e55b05b68 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.162415 Mar 08 19:27:42.759140 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 521/1035] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:42 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:43.775311 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-3f2d93ae-d342-44f6-a54f-d829146863f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:43.775946 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-3f2d93ae-d342-44f6-a54f-d829146863f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:43.782372 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3f2d93ae-d342-44f6-a54f-d829146863f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:43.782944 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3f2d93ae-d342-44f6-a54f-d829146863f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:43.783850 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3f2d93ae-d342-44f6-a54f-d829146863f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:43.784316 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-3f2d93ae-d342-44f6-a54f-d829146863f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:44.182822 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-3f2d93ae-d342-44f6-a54f-d829146863f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:44.190886 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-3f2d93ae-d342-44f6-a54f-d829146863f3 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.419165 Mar 08 19:27:44.191472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 515/1036] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:43 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:45.209106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ae4c7d91-a5da-4473-9e93-777d23be0b14 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:45.209643 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ae4c7d91-a5da-4473-9e93-777d23be0b14 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:45.216061 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae4c7d91-a5da-4473-9e93-777d23be0b14 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:45.216511 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae4c7d91-a5da-4473-9e93-777d23be0b14 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:45.217276 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae4c7d91-a5da-4473-9e93-777d23be0b14 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:45.217714 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ae4c7d91-a5da-4473-9e93-777d23be0b14 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:45.351563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ae4c7d91-a5da-4473-9e93-777d23be0b14 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:45.359472 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ae4c7d91-a5da-4473-9e93-777d23be0b14 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.155184 Mar 08 19:27:45.360465 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 522/1037] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:45 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:46.430828 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-129000a8-f355-49af-9e3d-1185ee29caa0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:46.431453 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-129000a8-f355-49af-9e3d-1185ee29caa0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:46.437890 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-129000a8-f355-49af-9e3d-1185ee29caa0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:46.438341 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-129000a8-f355-49af-9e3d-1185ee29caa0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:46.439279 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-129000a8-f355-49af-9e3d-1185ee29caa0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:46.439657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-129000a8-f355-49af-9e3d-1185ee29caa0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:46.577587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-129000a8-f355-49af-9e3d-1185ee29caa0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:46.585151 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-129000a8-f355-49af-9e3d-1185ee29caa0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.158331 Mar 08 19:27:46.585712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 516/1038] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:46 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:47.601572 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0b38826a-a995-4f8a-90c1-ea8778151988 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:47.602248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0b38826a-a995-4f8a-90c1-ea8778151988 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:47.608801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b38826a-a995-4f8a-90c1-ea8778151988 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:47.609296 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b38826a-a995-4f8a-90c1-ea8778151988 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:47.610094 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b38826a-a995-4f8a-90c1-ea8778151988 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:47.610532 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0b38826a-a995-4f8a-90c1-ea8778151988 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:47.747097 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0b38826a-a995-4f8a-90c1-ea8778151988 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:47.755110 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0b38826a-a995-4f8a-90c1-ea8778151988 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.157371 Mar 08 19:27:47.755679 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 523/1039] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:47 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:48.772648 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0c95f73c-4766-4f12-8cfb-d75a45db0eb1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:48.773322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0c95f73c-4766-4f12-8cfb-d75a45db0eb1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:48.779417 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0c95f73c-4766-4f12-8cfb-d75a45db0eb1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:48.779862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0c95f73c-4766-4f12-8cfb-d75a45db0eb1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:48.780647 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0c95f73c-4766-4f12-8cfb-d75a45db0eb1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:48.781080 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0c95f73c-4766-4f12-8cfb-d75a45db0eb1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:48.922903 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0c95f73c-4766-4f12-8cfb-d75a45db0eb1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:48.930864 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0c95f73c-4766-4f12-8cfb-d75a45db0eb1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.162069 Mar 08 19:27:48.931448 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 517/1040] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:48 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:49.947778 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ba904572-450d-49f9-945a-0149af9113c0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:49.948420 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ba904572-450d-49f9-945a-0149af9113c0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:49.954754 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba904572-450d-49f9-945a-0149af9113c0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:49.955268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba904572-450d-49f9-945a-0149af9113c0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:49.956208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba904572-450d-49f9-945a-0149af9113c0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:49.956648 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ba904572-450d-49f9-945a-0149af9113c0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:50.096143 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ba904572-450d-49f9-945a-0149af9113c0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:50.103605 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ba904572-450d-49f9-945a-0149af9113c0 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.159731 Mar 08 19:27:50.104196 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 524/1041] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:49 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:51.121244 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-230211e0-8341-434b-bb4e-e18e10cc04bb tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:51.121836 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-230211e0-8341-434b-bb4e-e18e10cc04bb tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:51.128371 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-230211e0-8341-434b-bb4e-e18e10cc04bb tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:51.128819 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-230211e0-8341-434b-bb4e-e18e10cc04bb tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:51.129578 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-230211e0-8341-434b-bb4e-e18e10cc04bb tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:51.130020 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-230211e0-8341-434b-bb4e-e18e10cc04bb tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:51.276579 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-230211e0-8341-434b-bb4e-e18e10cc04bb tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:51.284607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-230211e0-8341-434b-bb4e-e18e10cc04bb tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.167242 Mar 08 19:27:51.285173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 518/1042] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:51 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:52.302560 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-fe775907-f411-4faa-97d0-09589597124e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:52.303200 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-fe775907-f411-4faa-97d0-09589597124e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:52.309684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fe775907-f411-4faa-97d0-09589597124e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:52.310134 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fe775907-f411-4faa-97d0-09589597124e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:52.310916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fe775907-f411-4faa-97d0-09589597124e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:52.311355 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-fe775907-f411-4faa-97d0-09589597124e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:52.447448 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-fe775907-f411-4faa-97d0-09589597124e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:52.455593 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-fe775907-f411-4faa-97d0-09589597124e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1566 microversion: 2.1 time: 0.156874 Mar 08 19:27:52.456203 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 525/1043] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:52 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:52.472699 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-64608529-3aa0-4196-a39e-aa725cdef79e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:27:52.473313 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-64608529-3aa0-4196-a39e-aa725cdef79e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:52.479801 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64608529-3aa0-4196-a39e-aa725cdef79e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:52.486299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64608529-3aa0-4196-a39e-aa725cdef79e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:52.486299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64608529-3aa0-4196-a39e-aa725cdef79e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:52.486299 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-64608529-3aa0-4196-a39e-aa725cdef79e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:52.799998 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-64608529-3aa0-4196-a39e-aa725cdef79e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "POST /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61/action" status: 202 len: 0 microversion: 2.1 time: 0.331936 Mar 08 19:27:52.800857 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 519/1044] 10.222.0.75 () {60 vars in 1277 bytes} [Tue Mar 8 19:27:52 2022] POST /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 08 19:27:52.809139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1fb52363-ff84-4756-b914-dd67d0182f9b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:52.809960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1fb52363-ff84-4756-b914-dd67d0182f9b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:52.816875 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1fb52363-ff84-4756-b914-dd67d0182f9b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:52.824079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1fb52363-ff84-4756-b914-dd67d0182f9b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:52.824079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1fb52363-ff84-4756-b914-dd67d0182f9b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:52.824079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-1fb52363-ff84-4756-b914-dd67d0182f9b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:52.962631 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1fb52363-ff84-4756-b914-dd67d0182f9b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:52.970774 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1fb52363-ff84-4756-b914-dd67d0182f9b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1514 microversion: 2.1 time: 0.165046 Mar 08 19:27:52.971534 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 526/1045] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:52 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:27:53.988802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-26b6d577-5db7-4935-bdc0-17a0951e223b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:53.989413 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-26b6d577-5db7-4935-bdc0-17a0951e223b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:53.995702 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-26b6d577-5db7-4935-bdc0-17a0951e223b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:53.996178 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-26b6d577-5db7-4935-bdc0-17a0951e223b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:53.996937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-26b6d577-5db7-4935-bdc0-17a0951e223b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:53.997369 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-26b6d577-5db7-4935-bdc0-17a0951e223b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:54.135241 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-26b6d577-5db7-4935-bdc0-17a0951e223b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:54.142971 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-26b6d577-5db7-4935-bdc0-17a0951e223b tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1514 microversion: 2.1 time: 0.158752 Mar 08 19:27:54.143732 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 520/1046] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:53 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:55.160782 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-2fc7034e-4d13-45d7-8c64-e70280062d1e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:55.161396 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-2fc7034e-4d13-45d7-8c64-e70280062d1e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:55.167978 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2fc7034e-4d13-45d7-8c64-e70280062d1e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:55.168429 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2fc7034e-4d13-45d7-8c64-e70280062d1e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:55.169210 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2fc7034e-4d13-45d7-8c64-e70280062d1e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:55.169657 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-2fc7034e-4d13-45d7-8c64-e70280062d1e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:55.314079 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-2fc7034e-4d13-45d7-8c64-e70280062d1e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:55.321634 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-2fc7034e-4d13-45d7-8c64-e70280062d1e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1514 microversion: 2.1 time: 0.165370 Mar 08 19:27:55.322205 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 527/1047] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:55 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:56.301617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-e00b0f8b-7529-47d6-9efa-2ad247ed5066 req-639b8b93-11d2-4639-8339-e2a35efab444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015a3ea6-135a-4574-a5a1-e7ebeb9a7a61", "name": "network-vif-unplugged", "status": "completed", "tag": "55a93dab-2682-44a0-9a81-5794b54922a7"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:27:56.309657 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-e00b0f8b-7529-47d6-9efa-2ad247ed5066 req-639b8b93-11d2-4639-8339-e2a35efab444 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:56.310096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-e00b0f8b-7529-47d6-9efa-2ad247ed5066 req-639b8b93-11d2-4639-8339-e2a35efab444 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:56.321911 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.compute.server_external_events [req-e00b0f8b-7529-47d6-9efa-2ad247ed5066 req-639b8b93-11d2-4639-8339-e2a35efab444 service nova] Unable to find a host for instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61. Dropping event network-vif-unplugged {{(pid=117390) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 08 19:27:56.324719 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-e00b0f8b-7529-47d6-9efa-2ad247ed5066 req-639b8b93-11d2-4639-8339-e2a35efab444 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.084152 Mar 08 19:27:56.324719 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 521/1048] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 85 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 08 19:27:56.338807 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7882139b-1544-4f36-b794-dff0ebf5044c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:56.339585 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7882139b-1544-4f36-b794-dff0ebf5044c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:56.355092 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7882139b-1544-4f36-b794-dff0ebf5044c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:56.355548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7882139b-1544-4f36-b794-dff0ebf5044c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:56.356365 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7882139b-1544-4f36-b794-dff0ebf5044c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:56.356801 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7882139b-1544-4f36-b794-dff0ebf5044c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:56.500208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7882139b-1544-4f36-b794-dff0ebf5044c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:56.508506 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7882139b-1544-4f36-b794-dff0ebf5044c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1514 microversion: 2.1 time: 0.173694 Mar 08 19:27:56.509077 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 528/1049] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:56 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:27:57.526084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-89f3ffe1-9607-4e1a-9dff-b1f8c94da89c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:57.526685 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-89f3ffe1-9607-4e1a-9dff-b1f8c94da89c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:57.533423 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-89f3ffe1-9607-4e1a-9dff-b1f8c94da89c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:57.533868 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-89f3ffe1-9607-4e1a-9dff-b1f8c94da89c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:57.534635 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-89f3ffe1-9607-4e1a-9dff-b1f8c94da89c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:57.535068 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-89f3ffe1-9607-4e1a-9dff-b1f8c94da89c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:57.672612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-89f3ffe1-9607-4e1a-9dff-b1f8c94da89c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:57.680943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-89f3ffe1-9607-4e1a-9dff-b1f8c94da89c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1514 microversion: 2.1 time: 0.158764 Mar 08 19:27:57.681502 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 522/1050] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:57 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:58.698048 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0d3b28bf-8c7d-44e9-b215-a7dea4ca7b0c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:58.698665 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0d3b28bf-8c7d-44e9-b215-a7dea4ca7b0c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:58.705895 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d3b28bf-8c7d-44e9-b215-a7dea4ca7b0c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:58.706340 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d3b28bf-8c7d-44e9-b215-a7dea4ca7b0c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:58.707104 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d3b28bf-8c7d-44e9-b215-a7dea4ca7b0c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:58.707538 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0d3b28bf-8c7d-44e9-b215-a7dea4ca7b0c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:58.841682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0d3b28bf-8c7d-44e9-b215-a7dea4ca7b0c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:27:58.849731 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0d3b28bf-8c7d-44e9-b215-a7dea4ca7b0c tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1516 microversion: 2.1 time: 0.155580 Mar 08 19:27:58.850292 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 529/1051] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:58 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:27:59.867109 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6a0cc354-5857-41f3-987d-57254eaa63ea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:27:59.867731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6a0cc354-5857-41f3-987d-57254eaa63ea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:27:59.874248 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a0cc354-5857-41f3-987d-57254eaa63ea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:59.874705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a0cc354-5857-41f3-987d-57254eaa63ea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:27:59.875483 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a0cc354-5857-41f3-987d-57254eaa63ea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:27:59.876475 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6a0cc354-5857-41f3-987d-57254eaa63ea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:00.118491 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6a0cc354-5857-41f3-987d-57254eaa63ea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:00.127318 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6a0cc354-5857-41f3-987d-57254eaa63ea tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.263024 Mar 08 19:28:00.127905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 523/1052] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:27:59 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:01.144970 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-23799e5e-cfb2-4630-8edd-69686928a967 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:01.145577 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-23799e5e-cfb2-4630-8edd-69686928a967 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:01.152376 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-23799e5e-cfb2-4630-8edd-69686928a967 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:01.152832 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-23799e5e-cfb2-4630-8edd-69686928a967 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:01.153616 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-23799e5e-cfb2-4630-8edd-69686928a967 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:01.154051 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-23799e5e-cfb2-4630-8edd-69686928a967 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:01.292147 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-23799e5e-cfb2-4630-8edd-69686928a967 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:01.299817 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-23799e5e-cfb2-4630-8edd-69686928a967 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.159328 Mar 08 19:28:01.300487 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 530/1053] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:01 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:02.317569 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5c5c1afa-cbaf-46f5-8e03-99f0dc033d36 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:02.318101 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5c5c1afa-cbaf-46f5-8e03-99f0dc033d36 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:02.324972 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5c5c1afa-cbaf-46f5-8e03-99f0dc033d36 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:02.325416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5c5c1afa-cbaf-46f5-8e03-99f0dc033d36 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:02.326183 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5c5c1afa-cbaf-46f5-8e03-99f0dc033d36 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:02.326615 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5c5c1afa-cbaf-46f5-8e03-99f0dc033d36 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:02.460375 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5c5c1afa-cbaf-46f5-8e03-99f0dc033d36 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:02.468167 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5c5c1afa-cbaf-46f5-8e03-99f0dc033d36 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.154930 Mar 08 19:28:02.468859 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 524/1054] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:02 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:28:03.487046 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-93964843-8a49-494b-b357-b13e75df378f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:03.487665 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-93964843-8a49-494b-b357-b13e75df378f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:03.494159 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93964843-8a49-494b-b357-b13e75df378f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:03.494609 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93964843-8a49-494b-b357-b13e75df378f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:03.495376 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93964843-8a49-494b-b357-b13e75df378f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:03.495811 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-93964843-8a49-494b-b357-b13e75df378f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:03.632063 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-93964843-8a49-494b-b357-b13e75df378f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:03.639330 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-93964843-8a49-494b-b357-b13e75df378f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.156929 Mar 08 19:28:03.639891 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 531/1055] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:03 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:04.656285 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1f74108f-9532-4f37-b87d-92b239b04867 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:04.656896 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1f74108f-9532-4f37-b87d-92b239b04867 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:04.664034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1f74108f-9532-4f37-b87d-92b239b04867 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:04.664484 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1f74108f-9532-4f37-b87d-92b239b04867 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:04.665245 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1f74108f-9532-4f37-b87d-92b239b04867 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:04.671092 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1f74108f-9532-4f37-b87d-92b239b04867 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:04.805319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1f74108f-9532-4f37-b87d-92b239b04867 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:04.812553 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1f74108f-9532-4f37-b87d-92b239b04867 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.160124 Mar 08 19:28:04.813114 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 525/1056] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:04 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:05.833302 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-51250129-94f6-49a2-9bb3-6b5fa7ee98e6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:05.833918 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-51250129-94f6-49a2-9bb3-6b5fa7ee98e6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:05.840321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-51250129-94f6-49a2-9bb3-6b5fa7ee98e6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:05.840823 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-51250129-94f6-49a2-9bb3-6b5fa7ee98e6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:05.841539 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-51250129-94f6-49a2-9bb3-6b5fa7ee98e6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:05.841976 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-51250129-94f6-49a2-9bb3-6b5fa7ee98e6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:05.978347 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-51250129-94f6-49a2-9bb3-6b5fa7ee98e6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:05.985840 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-51250129-94f6-49a2-9bb3-6b5fa7ee98e6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.156478 Mar 08 19:28:05.986411 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 532/1057] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:05 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:07.004033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2d27e065-a712-486b-b064-34c0bb690b63 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:07.004698 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2d27e065-a712-486b-b064-34c0bb690b63 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:07.011054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2d27e065-a712-486b-b064-34c0bb690b63 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:07.011506 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2d27e065-a712-486b-b064-34c0bb690b63 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:07.012307 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2d27e065-a712-486b-b064-34c0bb690b63 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:07.012752 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2d27e065-a712-486b-b064-34c0bb690b63 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:07.147234 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2d27e065-a712-486b-b064-34c0bb690b63 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:07.154604 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2d27e065-a712-486b-b064-34c0bb690b63 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.155056 Mar 08 19:28:07.155173 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 526/1058] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:06 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:08.172375 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f1cc9981-65bf-46d4-9b97-06ea8f0d8390 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:08.173608 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f1cc9981-65bf-46d4-9b97-06ea8f0d8390 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:08.180284 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f1cc9981-65bf-46d4-9b97-06ea8f0d8390 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:08.180677 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f1cc9981-65bf-46d4-9b97-06ea8f0d8390 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:08.181456 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f1cc9981-65bf-46d4-9b97-06ea8f0d8390 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:08.181896 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f1cc9981-65bf-46d4-9b97-06ea8f0d8390 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:08.321927 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f1cc9981-65bf-46d4-9b97-06ea8f0d8390 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:08.330000 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f1cc9981-65bf-46d4-9b97-06ea8f0d8390 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.161578 Mar 08 19:28:08.330571 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 533/1059] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:08 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:09.347271 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f8a2b19e-9b23-4cb4-a3b5-aecfc7a3aae1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:09.347938 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f8a2b19e-9b23-4cb4-a3b5-aecfc7a3aae1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:09.354338 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f8a2b19e-9b23-4cb4-a3b5-aecfc7a3aae1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:09.354790 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f8a2b19e-9b23-4cb4-a3b5-aecfc7a3aae1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:09.355558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f8a2b19e-9b23-4cb4-a3b5-aecfc7a3aae1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:09.356023 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f8a2b19e-9b23-4cb4-a3b5-aecfc7a3aae1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:09.489074 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-f8a2b19e-9b23-4cb4-a3b5-aecfc7a3aae1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:09.496596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f8a2b19e-9b23-4cb4-a3b5-aecfc7a3aae1 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.153871 Mar 08 19:28:09.497222 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 527/1060] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:09 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:10.331840 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-5771b33b-110f-4257-b514-54c2aa016088 req-daa91597-41bb-4d13-a145-bcba9ad5c2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015a3ea6-135a-4574-a5a1-e7ebeb9a7a61", "name": "network-vif-plugged", "status": "completed", "tag": "55a93dab-2682-44a0-9a81-5794b54922a7"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:28:10.339910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-5771b33b-110f-4257-b514-54c2aa016088 req-daa91597-41bb-4d13-a145-bcba9ad5c2a8 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:10.340392 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-5771b33b-110f-4257-b514-54c2aa016088 req-daa91597-41bb-4d13-a145-bcba9ad5c2a8 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:10.351846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-5771b33b-110f-4257-b514-54c2aa016088 req-daa91597-41bb-4d13-a145-bcba9ad5c2a8 service nova] Creating event network-vif-plugged:55a93dab-2682-44a0-9a81-5794b54922a7 for instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 on hv-cinder-83009 Mar 08 19:28:10.356819 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-5771b33b-110f-4257-b514-54c2aa016088 req-daa91597-41bb-4d13-a145-bcba9ad5c2a8 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028989 Mar 08 19:28:10.357410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 534/1061] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:28:10.514652 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-58e5eb2a-365c-40a2-8134-e42526f70f74 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:10.515272 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-58e5eb2a-365c-40a2-8134-e42526f70f74 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:10.522935 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-58e5eb2a-365c-40a2-8134-e42526f70f74 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:10.523939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-58e5eb2a-365c-40a2-8134-e42526f70f74 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:10.524811 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-58e5eb2a-365c-40a2-8134-e42526f70f74 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:10.525532 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-58e5eb2a-365c-40a2-8134-e42526f70f74 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:10.696943 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-58e5eb2a-365c-40a2-8134-e42526f70f74 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:10.704463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-58e5eb2a-365c-40a2-8134-e42526f70f74 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.193700 Mar 08 19:28:10.705032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 528/1062] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:10 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:28:11.723254 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-e57dcbf9-db08-4437-b35a-6cfb2f682abe tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:11.724006 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-e57dcbf9-db08-4437-b35a-6cfb2f682abe tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:11.731612 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e57dcbf9-db08-4437-b35a-6cfb2f682abe tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:11.732097 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e57dcbf9-db08-4437-b35a-6cfb2f682abe tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:11.732877 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e57dcbf9-db08-4437-b35a-6cfb2f682abe tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:11.733321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-e57dcbf9-db08-4437-b35a-6cfb2f682abe tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:11.886029 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-e57dcbf9-db08-4437-b35a-6cfb2f682abe tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:11.895883 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-e57dcbf9-db08-4437-b35a-6cfb2f682abe tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1572 microversion: 2.1 time: 0.177864 Mar 08 19:28:11.896494 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 535/1063] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:11 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1572 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:28:12.913543 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-33d61dea-c842-4e9a-ac59-98d547803d15 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:28:12.914150 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-33d61dea-c842-4e9a-ac59-98d547803d15 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:28:12.920108 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-33d61dea-c842-4e9a-ac59-98d547803d15 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:12.920563 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-33d61dea-c842-4e9a-ac59-98d547803d15 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:12.921328 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-33d61dea-c842-4e9a-ac59-98d547803d15 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:28:12.921762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-33d61dea-c842-4e9a-ac59-98d547803d15 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:28:13.058878 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-33d61dea-c842-4e9a-ac59-98d547803d15 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:28:13.066849 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-33d61dea-c842-4e9a-ac59-98d547803d15 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1559 microversion: 2.1 time: 0.157215 Mar 08 19:28:13.067416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 529/1064] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:28:12 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:29:50.184979 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6621c305-4101-44ef-8a7c-5279881ffac2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:29:50.185568 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6621c305-4101-44ef-8a7c-5279881ffac2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:29:50.195172 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6621c305-4101-44ef-8a7c-5279881ffac2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:50.195635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6621c305-4101-44ef-8a7c-5279881ffac2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:50.196476 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6621c305-4101-44ef-8a7c-5279881ffac2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:50.196939 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6621c305-4101-44ef-8a7c-5279881ffac2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:50.224615 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6621c305-4101-44ef-8a7c-5279881ffac2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:29:50.250755 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-d53e25ab-3ce6-4f8f-8b98-fa85f8ce17d4 req-e17ec11b-7bb8-4775-bfe6-dc263370c354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "015a3ea6-135a-4574-a5a1-e7ebeb9a7a61", "tag": "55a93dab-2682-44a0-9a81-5794b54922a7"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:29:50.260840 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-d53e25ab-3ce6-4f8f-8b98-fa85f8ce17d4 req-e17ec11b-7bb8-4775-bfe6-dc263370c354 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:50.261608 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-d53e25ab-3ce6-4f8f-8b98-fa85f8ce17d4 req-e17ec11b-7bb8-4775-bfe6-dc263370c354 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:50.274687 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-d53e25ab-3ce6-4f8f-8b98-fa85f8ce17d4 req-e17ec11b-7bb8-4775-bfe6-dc263370c354 service nova] Creating event network-changed:55a93dab-2682-44a0-9a81-5794b54922a7 for instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 on hv-cinder-83009 Mar 08 19:29:50.281082 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-d53e25ab-3ce6-4f8f-8b98-fa85f8ce17d4 req-e17ec11b-7bb8-4775-bfe6-dc263370c354 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102833 Mar 08 19:29:50.281697 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 530/1065] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:29:50.465787 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6621c305-4101-44ef-8a7c-5279881ffac2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "DELETE /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 204 len: 0 microversion: 2.1 time: 0.290817 Mar 08 19:29:50.466382 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 536/1066] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:29:50 2022] DELETE /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:29:50.476367 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1d671bef-285e-4c7d-84c0-f47cf99b06e2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:29:50.477160 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1d671bef-285e-4c7d-84c0-f47cf99b06e2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:29:50.488001 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1d671bef-285e-4c7d-84c0-f47cf99b06e2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:50.488465 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1d671bef-285e-4c7d-84c0-f47cf99b06e2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:50.489776 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1d671bef-285e-4c7d-84c0-f47cf99b06e2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:50.489776 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1d671bef-285e-4c7d-84c0-f47cf99b06e2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:50.767829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1d671bef-285e-4c7d-84c0-f47cf99b06e2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:29:50.776034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1d671bef-285e-4c7d-84c0-f47cf99b06e2 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1565 microversion: 2.1 time: 0.304989 Mar 08 19:29:50.776865 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 531/1067] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:29:50 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1565 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:29:51.796809 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-465cf078-7b12-474a-b72d-ed888bc1e49d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:29:51.797968 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-465cf078-7b12-474a-b72d-ed888bc1e49d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:29:51.808730 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-465cf078-7b12-474a-b72d-ed888bc1e49d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:51.810128 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-465cf078-7b12-474a-b72d-ed888bc1e49d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:51.811174 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-465cf078-7b12-474a-b72d-ed888bc1e49d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:51.811958 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-465cf078-7b12-474a-b72d-ed888bc1e49d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:52.045965 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-465cf078-7b12-474a-b72d-ed888bc1e49d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:29:52.059727 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-465cf078-7b12-474a-b72d-ed888bc1e49d tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1447 microversion: 2.1 time: 0.267525 Mar 08 19:29:52.060847 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 537/1068] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:29:51 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1447 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:29:52.771245 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-62798120-0d79-4873-ab08-d1f395cd680f req-4cc68019-a199-4b0a-8b3d-474322edf5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "015a3ea6-135a-4574-a5a1-e7ebeb9a7a61", "name": "network-vif-deleted", "tag": "55a93dab-2682-44a0-9a81-5794b54922a7"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:29:52.780314 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-62798120-0d79-4873-ab08-d1f395cd680f req-4cc68019-a199-4b0a-8b3d-474322edf5d2 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:52.780754 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-62798120-0d79-4873-ab08-d1f395cd680f req-4cc68019-a199-4b0a-8b3d-474322edf5d2 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:52.794351 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-62798120-0d79-4873-ab08-d1f395cd680f req-4cc68019-a199-4b0a-8b3d-474322edf5d2 service nova] Creating event network-vif-deleted:55a93dab-2682-44a0-9a81-5794b54922a7 for instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 on hv-cinder-83009 Mar 08 19:29:52.799893 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-62798120-0d79-4873-ab08-d1f395cd680f req-4cc68019-a199-4b0a-8b3d-474322edf5d2 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098334 Mar 08 19:29:52.804107 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 532/1069] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:29:53.092523 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-88792d6a-ec49-4f12-ab22-3f0efc8822bf tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:29:53.093834 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-88792d6a-ec49-4f12-ab22-3f0efc8822bf tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:29:53.105761 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-88792d6a-ec49-4f12-ab22-3f0efc8822bf tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:53.106502 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-88792d6a-ec49-4f12-ab22-3f0efc8822bf tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:53.107836 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-88792d6a-ec49-4f12-ab22-3f0efc8822bf tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:53.108600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-88792d6a-ec49-4f12-ab22-3f0efc8822bf tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:53.203813 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-88792d6a-ec49-4f12-ab22-3f0efc8822bf tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:29:53.213014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-88792d6a-ec49-4f12-ab22-3f0efc8822bf tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1217 microversion: 2.1 time: 0.127536 Mar 08 19:29:53.213862 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 538/1070] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:29:53 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1217 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:29:54.232159 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:29:54.232850 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:29:54.241060 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:54.242119 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:54.242976 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:54.243535 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:54.280419 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:54.280930 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:54.281421 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lazy-loading 'fault' on Instance uuid 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:29:54.344824 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4e83889107461b8b9033bdde57aa38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0e10c3c47a4ead8a5fd46c50273d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:29:54.355831 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4d999bc0-25c2-478a-8445-49cd57b7a88f tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 200 len: 1176 microversion: 2.1 time: 0.128324 Mar 08 19:29:54.356939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 533/1071] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:29:54 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 1176 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:29:55.375345 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:29:55.376035 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [instance: 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:29:55.383651 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:55.384368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:55.385327 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:29:55.385809 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:29:55.402354 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] HTTP exception thrown: Instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 could not be found. Mar 08 19:29:55.402956 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Returning 404 to user: Instance 015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:29:55.403829 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f8aac38d-7847-4f01-a4df-d025ccec899e tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61" status: 404 len: 111 microversion: 2.1 time: 0.032849 Mar 08 19:29:55.404438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 539/1072] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:29:55 2022] GET /compute/v2.1/servers/015a3ea6-135a-4574-a5a1-e7ebeb9a7a61 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:29:55.659635 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a07701ce-e0b9-4cc7-add4-47ac9f839ed6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] Calling method '.version_select at 0x7f4383781a60>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:29:55.666771 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a07701ce-e0b9-4cc7-add4-47ac9f839ed6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [9520f29b-c8b8-4167-bbb9-29a37b1c50f9] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 19:29:56.676713 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [None req-a07701ce-e0b9-4cc7-add4-47ac9f839ed6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] [9520f29b-c8b8-4167-bbb9-29a37b1c50f9] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54252. Mar 08 19:29:56.798705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a07701ce-e0b9-4cc7-add4-47ac9f839ed6 tempest-TestShelveInstance-1839188641 tempest-TestShelveInstance-1839188641-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-91040459" status: 202 len: 0 microversion: 2.1 time: 1.143607 Mar 08 19:29:56.799595 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 534/1073] 10.222.0.75 () {58 vars in 1247 bytes} [Tue Mar 8 19:29:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-91040459 => generated 0 bytes in 1146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:30:04.638569 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:30:04.639075 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:30:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:30:21.048680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-3016b8ae-e6e1-4d7f-b280-fe4ee8c79ebf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Action: 'create', calling method: .version_select at 0x7f4383de6430>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-693581338"}} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:30:21.066554 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-3016b8ae-e6e1-4d7f-b280-fe4ee8c79ebf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:30:21.070401 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-3016b8ae-e6e1-4d7f-b280-fe4ee8c79ebf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for user fb12f20385994767848ced10df127b66 and project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:30:21.083649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3016b8ae-e6e1-4d7f-b280-fe4ee8c79ebf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [d647460a-a09f-4b5f-83f3-6bc643f50721] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 19:30:22.092514 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [None req-3016b8ae-e6e1-4d7f-b280-fe4ee8c79ebf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [d647460a-a09f-4b5f-83f3-6bc643f50721] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54346. Mar 08 19:30:22.294992 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-3016b8ae-e6e1-4d7f-b280-fe4ee8c79ebf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:30:22.298692 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.quota [None req-3016b8ae-e6e1-4d7f-b280-fe4ee8c79ebf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for user fb12f20385994767848ced10df127b66 and project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'key_pairs'} {{(pid=117391) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:30:22.313604 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-3016b8ae-e6e1-4d7f-b280-fe4ee8c79ebf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.505322 Mar 08 19:30:22.314269 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 540/1074] 10.222.0.75 () {60 vars in 1157 bytes} [Tue Mar 8 19:30:20 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:30:35.862163 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:30:35.862714 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:30:48.177416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1959777344", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-693581338", "security_groups": [{"name": "tempest-secgroup-smoke-1260733439"}], "block_device_mapping_v2": [{"uuid": "7475458b-1644-4fef-b1c5-3d181251b313", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "072eacc7-3ff6-4869-b6d9-956588258e2f"}]}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:30:48.295515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] validate_networks() for [('072eacc7-3ff6-4869-b6d9-956588258e2f', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:30:48.764192 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:30:48.764611 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:30:48.765082 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:30:48.765492 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:30:48.765898 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:30:48.775006 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:48.775451 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:48.776283 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:48.776715 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:48.795011 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:30:48.798799 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for user fb12f20385994767848ced10df127b66 and project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:30:48.855730 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:30:48.857989 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7475458b-1644-4fef-b1c5-3d181251b313',volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:30:49.258435 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d14522d1-7423-4d7c-8fc6-9dd041438d29 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.086205 Mar 08 19:30:49.259170 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 535/1075] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:30:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:30:49.269387 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-73216326-1f3a-4fcc-94bb-379c86d71444 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:49.270255 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-73216326-1f3a-4fcc-94bb-379c86d71444 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:49.343230 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-73216326-1f3a-4fcc-94bb-379c86d71444 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:49.350674 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-73216326-1f3a-4fcc-94bb-379c86d71444 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1094 microversion: 2.1 time: 0.085576 Mar 08 19:30:49.351281 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 541/1076] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:49 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1094 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:30:50.371057 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-cc099cdf-c279-46d8-82c3-b0f37c449dd2 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:50.372168 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-cc099cdf-c279-46d8-82c3-b0f37c449dd2 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:50.381973 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cc099cdf-c279-46d8-82c3-b0f37c449dd2 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:50.387472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cc099cdf-c279-46d8-82c3-b0f37c449dd2 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:50.387472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cc099cdf-c279-46d8-82c3-b0f37c449dd2 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:50.387472 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-cc099cdf-c279-46d8-82c3-b0f37c449dd2 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:50.449075 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-cc099cdf-c279-46d8-82c3-b0f37c449dd2 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:50.456596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-cc099cdf-c279-46d8-82c3-b0f37c449dd2 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1144 microversion: 2.1 time: 0.093753 Mar 08 19:30:50.457412 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 536/1077] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:50 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:30:51.473685 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-12431e8b-6042-420e-acfc-a8f6a7f589c9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:51.474299 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-12431e8b-6042-420e-acfc-a8f6a7f589c9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:51.481409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12431e8b-6042-420e-acfc-a8f6a7f589c9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:51.481863 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12431e8b-6042-420e-acfc-a8f6a7f589c9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:51.483959 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12431e8b-6042-420e-acfc-a8f6a7f589c9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:51.484400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-12431e8b-6042-420e-acfc-a8f6a7f589c9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:51.590357 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-12431e8b-6042-420e-acfc-a8f6a7f589c9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:51.599242 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-12431e8b-6042-420e-acfc-a8f6a7f589c9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1200 microversion: 2.1 time: 0.129633 Mar 08 19:30:51.599818 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 542/1078] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:51 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1200 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:30:52.621871 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-ec963703-ddcb-45bd-b407-bd873b8d0d78 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:52.622451 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-ec963703-ddcb-45bd-b407-bd873b8d0d78 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:52.629705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ec963703-ddcb-45bd-b407-bd873b8d0d78 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:52.630143 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ec963703-ddcb-45bd-b407-bd873b8d0d78 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:52.630912 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ec963703-ddcb-45bd-b407-bd873b8d0d78 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:52.631347 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-ec963703-ddcb-45bd-b407-bd873b8d0d78 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:52.837204 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-ec963703-ddcb-45bd-b407-bd873b8d0d78 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:52.844754 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-ec963703-ddcb-45bd-b407-bd873b8d0d78 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1278 microversion: 2.1 time: 0.227238 Mar 08 19:30:52.845310 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 537/1079] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:52 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:30:53.240776 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-1569d14f-0043-4444-b814-89a75b2e2435 req-24d195f9-0ae5-47b3-8510-158fa1d90d57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbe5786-888f-49ea-bfeb-503e7d4433b8", "tag": "63b38b58-3db4-4a6c-a384-4d1adc8985e3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:30:53.251740 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-1569d14f-0043-4444-b814-89a75b2e2435 req-24d195f9-0ae5-47b3-8510-158fa1d90d57 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:53.252226 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-1569d14f-0043-4444-b814-89a75b2e2435 req-24d195f9-0ae5-47b3-8510-158fa1d90d57 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:53.266738 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-1569d14f-0043-4444-b814-89a75b2e2435 req-24d195f9-0ae5-47b3-8510-158fa1d90d57 service nova] Creating event network-changed:63b38b58-3db4-4a6c-a384-4d1adc8985e3 for instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 on hv-cinder-83009 Mar 08 19:30:53.273241 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-1569d14f-0043-4444-b814-89a75b2e2435 req-24d195f9-0ae5-47b3-8510-158fa1d90d57 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036597 Mar 08 19:30:53.273849 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 543/1080] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:30:53.862601 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-13dcbf81-0a49-4c1a-b928-e78d51270931 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:53.863731 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-13dcbf81-0a49-4c1a-b928-e78d51270931 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:53.870461 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-13dcbf81-0a49-4c1a-b928-e78d51270931 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:53.870911 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-13dcbf81-0a49-4c1a-b928-e78d51270931 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:53.871689 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-13dcbf81-0a49-4c1a-b928-e78d51270931 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:53.872164 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-13dcbf81-0a49-4c1a-b928-e78d51270931 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:54.326825 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-13dcbf81-0a49-4c1a-b928-e78d51270931 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:54.335177 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-13dcbf81-0a49-4c1a-b928-e78d51270931 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.476520 Mar 08 19:30:54.335727 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 538/1081] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:53 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:30:55.353430 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7b65daf0-31d8-4d31-aa75-fbb682b3dcee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:55.354044 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7b65daf0-31d8-4d31-aa75-fbb682b3dcee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:55.360452 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7b65daf0-31d8-4d31-aa75-fbb682b3dcee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:55.360990 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7b65daf0-31d8-4d31-aa75-fbb682b3dcee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:55.361768 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7b65daf0-31d8-4d31-aa75-fbb682b3dcee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:55.362209 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7b65daf0-31d8-4d31-aa75-fbb682b3dcee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:55.519684 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7b65daf0-31d8-4d31-aa75-fbb682b3dcee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:55.527373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7b65daf0-31d8-4d31-aa75-fbb682b3dcee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.178697 Mar 08 19:30:55.527966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 544/1082] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:55 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:30:56.544741 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-21eda090-a83a-4c00-997c-1a2187bffcb9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:56.545379 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-21eda090-a83a-4c00-997c-1a2187bffcb9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:56.552775 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-21eda090-a83a-4c00-997c-1a2187bffcb9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:56.553222 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-21eda090-a83a-4c00-997c-1a2187bffcb9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:56.553996 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-21eda090-a83a-4c00-997c-1a2187bffcb9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:56.554432 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-21eda090-a83a-4c00-997c-1a2187bffcb9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:56.695174 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-21eda090-a83a-4c00-997c-1a2187bffcb9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:56.703454 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-21eda090-a83a-4c00-997c-1a2187bffcb9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.162722 Mar 08 19:30:56.704252 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 539/1083] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:56 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:30:57.721279 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7d544752-c1ff-42d3-abf3-171ad92108ee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:57.721887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7d544752-c1ff-42d3-abf3-171ad92108ee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:57.729032 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7d544752-c1ff-42d3-abf3-171ad92108ee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:57.729490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7d544752-c1ff-42d3-abf3-171ad92108ee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:57.730793 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7d544752-c1ff-42d3-abf3-171ad92108ee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:57.731944 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7d544752-c1ff-42d3-abf3-171ad92108ee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:57.870544 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7d544752-c1ff-42d3-abf3-171ad92108ee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:57.878313 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7d544752-c1ff-42d3-abf3-171ad92108ee tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.160911 Mar 08 19:30:57.878972 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 545/1084] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:57 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:30:58.895445 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-08c2338f-7250-4bfb-8a5a-c3c7e7f91d05 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:30:58.896103 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-08c2338f-7250-4bfb-8a5a-c3c7e7f91d05 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:30:58.902663 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-08c2338f-7250-4bfb-8a5a-c3c7e7f91d05 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:58.903121 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-08c2338f-7250-4bfb-8a5a-c3c7e7f91d05 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:58.903905 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-08c2338f-7250-4bfb-8a5a-c3c7e7f91d05 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:30:58.904373 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-08c2338f-7250-4bfb-8a5a-c3c7e7f91d05 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:30:59.047129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-08c2338f-7250-4bfb-8a5a-c3c7e7f91d05 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:30:59.055466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-08c2338f-7250-4bfb-8a5a-c3c7e7f91d05 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.164183 Mar 08 19:30:59.056064 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 540/1085] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:30:58 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:31:00.072402 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c8c286aa-5579-4315-bee3-c84c8b92f7e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:31:00.072928 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c8c286aa-5579-4315-bee3-c84c8b92f7e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:31:00.079270 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8c286aa-5579-4315-bee3-c84c8b92f7e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:00.079724 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8c286aa-5579-4315-bee3-c84c8b92f7e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:00.080523 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8c286aa-5579-4315-bee3-c84c8b92f7e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:00.080966 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8c286aa-5579-4315-bee3-c84c8b92f7e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:00.220881 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c8c286aa-5579-4315-bee3-c84c8b92f7e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:31:00.228642 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c8c286aa-5579-4315-bee3-c84c8b92f7e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.160209 Mar 08 19:31:00.229208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 546/1086] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:31:00 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:31:01.245712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5b082c8e-f322-4509-87b6-4b2af7cd5e28 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:31:01.246284 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5b082c8e-f322-4509-87b6-4b2af7cd5e28 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:31:01.252553 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5b082c8e-f322-4509-87b6-4b2af7cd5e28 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:01.253008 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5b082c8e-f322-4509-87b6-4b2af7cd5e28 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:01.253976 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5b082c8e-f322-4509-87b6-4b2af7cd5e28 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:01.254416 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5b082c8e-f322-4509-87b6-4b2af7cd5e28 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:01.387514 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5b082c8e-f322-4509-87b6-4b2af7cd5e28 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:31:01.396123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5b082c8e-f322-4509-87b6-4b2af7cd5e28 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.154586 Mar 08 19:31:01.396689 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 541/1087] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:31:01 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:31:02.413957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-4ce39bd6-b780-41f8-bb7b-d627f1526ee1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:31:02.414556 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-4ce39bd6-b780-41f8-bb7b-d627f1526ee1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:31:02.420899 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ce39bd6-b780-41f8-bb7b-d627f1526ee1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:02.421338 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ce39bd6-b780-41f8-bb7b-d627f1526ee1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:02.422106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ce39bd6-b780-41f8-bb7b-d627f1526ee1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:02.422537 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-4ce39bd6-b780-41f8-bb7b-d627f1526ee1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:02.565451 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-4ce39bd6-b780-41f8-bb7b-d627f1526ee1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:31:02.573414 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-4ce39bd6-b780-41f8-bb7b-d627f1526ee1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.164478 Mar 08 19:31:02.573975 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 547/1088] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:31:02 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:31:03.594889 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-2c4941c5-1435-4a10-a8d0-65f80c752704 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:31:03.594889 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-2c4941c5-1435-4a10-a8d0-65f80c752704 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:31:03.600112 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2c4941c5-1435-4a10-a8d0-65f80c752704 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:03.600567 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2c4941c5-1435-4a10-a8d0-65f80c752704 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:03.601455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2c4941c5-1435-4a10-a8d0-65f80c752704 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:03.601894 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-2c4941c5-1435-4a10-a8d0-65f80c752704 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:03.737879 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-2c4941c5-1435-4a10-a8d0-65f80c752704 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:31:03.745653 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-2c4941c5-1435-4a10-a8d0-65f80c752704 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.158792 Mar 08 19:31:03.746230 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 542/1089] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:31:03 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:31:04.762346 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-165b64f6-60a1-48be-9bbf-b1e56ff25bf8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:31:04.762972 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-165b64f6-60a1-48be-9bbf-b1e56ff25bf8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:31:04.770310 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-165b64f6-60a1-48be-9bbf-b1e56ff25bf8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:04.770767 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-165b64f6-60a1-48be-9bbf-b1e56ff25bf8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:04.771570 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-165b64f6-60a1-48be-9bbf-b1e56ff25bf8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:04.772043 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-165b64f6-60a1-48be-9bbf-b1e56ff25bf8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:04.917071 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-165b64f6-60a1-48be-9bbf-b1e56ff25bf8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:31:04.924875 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-165b64f6-60a1-48be-9bbf-b1e56ff25bf8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.166382 Mar 08 19:31:04.926356 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 548/1090] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:31:04 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:31:05.184504 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-0489f4f1-ab4c-4d4c-bed7-56be228e36e4 req-430332f9-9c04-4711-b474-d40eba5c33ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbe5786-888f-49ea-bfeb-503e7d4433b8", "name": "network-vif-plugged", "status": "completed", "tag": "63b38b58-3db4-4a6c-a384-4d1adc8985e3"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:31:05.193044 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-0489f4f1-ab4c-4d4c-bed7-56be228e36e4 req-430332f9-9c04-4711-b474-d40eba5c33ab service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:05.193511 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-0489f4f1-ab4c-4d4c-bed7-56be228e36e4 req-430332f9-9c04-4711-b474-d40eba5c33ab service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:05.204255 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-0489f4f1-ab4c-4d4c-bed7-56be228e36e4 req-430332f9-9c04-4711-b474-d40eba5c33ab service nova] Creating event network-vif-plugged:63b38b58-3db4-4a6c-a384-4d1adc8985e3 for instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 on hv-cinder-83009 Mar 08 19:31:05.210327 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-0489f4f1-ab4c-4d4c-bed7-56be228e36e4 req-430332f9-9c04-4711-b474-d40eba5c33ab service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029589 Mar 08 19:31:05.211097 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 543/1091] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:31:05.942971 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b63710b3-58b7-4ef1-bcb1-e0e2bea86044 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:31:05.943601 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b63710b3-58b7-4ef1-bcb1-e0e2bea86044 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:31:05.949876 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b63710b3-58b7-4ef1-bcb1-e0e2bea86044 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:05.950322 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b63710b3-58b7-4ef1-bcb1-e0e2bea86044 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:05.951072 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b63710b3-58b7-4ef1-bcb1-e0e2bea86044 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:05.951501 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b63710b3-58b7-4ef1-bcb1-e0e2bea86044 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:06.083663 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b63710b3-58b7-4ef1-bcb1-e0e2bea86044 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:31:06.091173 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b63710b3-58b7-4ef1-bcb1-e0e2bea86044 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1266 microversion: 2.1 time: 0.152199 Mar 08 19:31:06.091751 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 549/1092] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:31:05 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:31:07.114435 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-fef0e8cc-5201-4576-9f30-afce31f1a215 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:31:07.117626 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-fef0e8cc-5201-4576-9f30-afce31f1a215 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:31:07.122321 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fef0e8cc-5201-4576-9f30-afce31f1a215 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:07.122782 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fef0e8cc-5201-4576-9f30-afce31f1a215 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:07.123557 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fef0e8cc-5201-4576-9f30-afce31f1a215 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:07.124034 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-fef0e8cc-5201-4576-9f30-afce31f1a215 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:07.266515 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-fef0e8cc-5201-4576-9f30-afce31f1a215 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:31:07.274455 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-fef0e8cc-5201-4576-9f30-afce31f1a215 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1453 microversion: 2.1 time: 0.164972 Mar 08 19:31:07.277686 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 544/1093] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:31:07 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:31:07.291043 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-5f3eed32-57c2-4894-89ef-fbdcc4ea7559 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:31:07.291649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-5f3eed32-57c2-4894-89ef-fbdcc4ea7559 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:31:07.297719 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5f3eed32-57c2-4894-89ef-fbdcc4ea7559 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:07.304080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5f3eed32-57c2-4894-89ef-fbdcc4ea7559 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:07.304080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5f3eed32-57c2-4894-89ef-fbdcc4ea7559 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:07.304080 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-5f3eed32-57c2-4894-89ef-fbdcc4ea7559 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:07.436097 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-5f3eed32-57c2-4894-89ef-fbdcc4ea7559 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:31:07.444118 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-5f3eed32-57c2-4894-89ef-fbdcc4ea7559 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1453 microversion: 2.1 time: 0.156956 Mar 08 19:31:07.444691 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 550/1094] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:31:07 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:31:09.765162 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-a5c173c2-3cb1-4593-a4c5-08864a676b5c req-1c35b6aa-8c62-4992-b50e-1fce7c1f2c8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffbe5786-888f-49ea-bfeb-503e7d4433b8", "tag": "63b38b58-3db4-4a6c-a384-4d1adc8985e3"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:31:09.774322 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-a5c173c2-3cb1-4593-a4c5-08864a676b5c req-1c35b6aa-8c62-4992-b50e-1fce7c1f2c8d service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:31:09.774771 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-a5c173c2-3cb1-4593-a4c5-08864a676b5c req-1c35b6aa-8c62-4992-b50e-1fce7c1f2c8d service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:31:09.787276 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-a5c173c2-3cb1-4593-a4c5-08864a676b5c req-1c35b6aa-8c62-4992-b50e-1fce7c1f2c8d service nova] Creating event network-changed:63b38b58-3db4-4a6c-a384-4d1adc8985e3 for instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 on hv-cinder-83009 Mar 08 19:31:09.792838 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-a5c173c2-3cb1-4593-a4c5-08864a676b5c req-1c35b6aa-8c62-4992-b50e-1fce7c1f2c8d service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031423 Mar 08 19:31:09.793466 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 545/1095] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:33:23.590013 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:23.590735 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:23.598076 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:23.598575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:23.599430 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:23.599945 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:23.630539 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:33:23.866215 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: ERROR oslo.messaging._drivers.impl_rabbit [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [1797aa42-8ed7-43df-9b7d-c945a9fc5fed] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 19:33:24.648535 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:33:24.649291 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:33:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 (ip 10.222.0.75) !!! Mar 08 19:33:24.874973 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [1797aa42-8ed7-43df-9b7d-c945a9fc5fed] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54590. Mar 08 19:33:24.965915 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-42da8ee4-e5db-45cd-acc5-a7cc00536844 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 204 len: 0 microversion: 2.1 time: 1.381265 Mar 08 19:33:24.967030 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 551/1096] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:33:23 2022] DELETE /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 0 bytes in 1383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 08 19:33:24.973982 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9b499291-787a-4b22-92fa-c6cbead36a8e] AMQP server on 10.222.0.75:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 08 19:33:24.980076 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6f707a5d-c9cf-4253-8b49-47f343c57271 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:24.981017 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6f707a5d-c9cf-4253-8b49-47f343c57271 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:24.988237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6f707a5d-c9cf-4253-8b49-47f343c57271 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:24.991963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6f707a5d-c9cf-4253-8b49-47f343c57271 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:24.991963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6f707a5d-c9cf-4253-8b49-47f343c57271 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:24.991963 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6f707a5d-c9cf-4253-8b49-47f343c57271 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:25.140463 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6f707a5d-c9cf-4253-8b49-47f343c57271 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:25.149555 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6f707a5d-c9cf-4253-8b49-47f343c57271 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1578 microversion: 2.1 time: 0.177796 Mar 08 19:33:25.150198 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 546/1097] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:24 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:26.168662 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c8808922-9898-48b1-814a-72efc035c4e5 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:26.169556 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c8808922-9898-48b1-814a-72efc035c4e5 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:26.177518 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8808922-9898-48b1-814a-72efc035c4e5 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:26.177968 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8808922-9898-48b1-814a-72efc035c4e5 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:26.178771 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8808922-9898-48b1-814a-72efc035c4e5 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:26.179204 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c8808922-9898-48b1-814a-72efc035c4e5 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:26.342892 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c8808922-9898-48b1-814a-72efc035c4e5 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:26.351169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c8808922-9898-48b1-814a-72efc035c4e5 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1578 microversion: 2.1 time: 0.187038 Mar 08 19:33:26.352904 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 552/1098] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:26 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1578 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:33:27.370675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e28fbf8e-3b61-4505-8df0-ef15d728bca6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:27.371614 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e28fbf8e-3b61-4505-8df0-ef15d728bca6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:27.380500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e28fbf8e-3b61-4505-8df0-ef15d728bca6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:27.380500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e28fbf8e-3b61-4505-8df0-ef15d728bca6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:27.380500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e28fbf8e-3b61-4505-8df0-ef15d728bca6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:27.381063 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e28fbf8e-3b61-4505-8df0-ef15d728bca6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:27.401269 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] [9b499291-787a-4b22-92fa-c6cbead36a8e] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54606. Mar 08 19:33:27.497364 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e28fbf8e-3b61-4505-8df0-ef15d728bca6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:27.505395 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e28fbf8e-3b61-4505-8df0-ef15d728bca6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1510 microversion: 2.1 time: 0.139906 Mar 08 19:33:27.505983 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 547/1099] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:27 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1510 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:27.756438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-86fe4292-4c7a-4075-888a-6bf0f341e79f req-dd20fcba-c305-48fa-8bfb-f5ddf2828e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffbe5786-888f-49ea-bfeb-503e7d4433b8", "name": "network-vif-deleted", "tag": "63b38b58-3db4-4a6c-a384-4d1adc8985e3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:33:27.774413 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-86fe4292-4c7a-4075-888a-6bf0f341e79f req-dd20fcba-c305-48fa-8bfb-f5ddf2828e8c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:27.775468 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-86fe4292-4c7a-4075-888a-6bf0f341e79f req-dd20fcba-c305-48fa-8bfb-f5ddf2828e8c service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:27.791585 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-86fe4292-4c7a-4075-888a-6bf0f341e79f req-dd20fcba-c305-48fa-8bfb-f5ddf2828e8c service nova] Creating event network-vif-deleted:63b38b58-3db4-4a6c-a384-4d1adc8985e3 for instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 on hv-cinder-83009 Mar 08 19:33:27.799820 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-86fe4292-4c7a-4075-888a-6bf0f341e79f req-dd20fcba-c305-48fa-8bfb-f5ddf2828e8c service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056711 Mar 08 19:33:27.802760 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 553/1100] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:33:28.523209 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:28.523830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:28.531390 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:28.531868 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:28.532744 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:28.533199 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:28.568799 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:28.569223 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:28.569681 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.objects.instance [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lazy-loading 'fault' on Instance uuid ffbe5786-888f-49ea-bfeb-503e7d4433b8 {{(pid=117390) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:33:28.617923 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:28.626665 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-84a59fba-6fdf-4b03-a5e6-e0915e37fe79 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 200 len: 1230 microversion: 2.1 time: 0.107317 Mar 08 19:33:28.628204 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 548/1101] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:28 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:29.645757 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:29.646490 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:29.653240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:29.654552 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:29.655356 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:29.655795 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:29.669659 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] HTTP exception thrown: Instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 could not be found. Mar 08 19:33:29.670286 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Returning 404 to user: Instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:33:29.671123 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d08f432a-7607-4acc-bf3e-ac4d5e8a5ce8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 404 len: 111 microversion: 2.1 time: 0.029705 Mar 08 19:33:29.671680 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 554/1102] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:29 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:33:29.748770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-48466991", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-693581338", "security_groups": [{"name": "tempest-secgroup-smoke-1260733439"}], "block_device_mapping_v2": [{"uuid": "7475458b-1644-4fef-b1c5-3d181251b313", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "072eacc7-3ff6-4869-b6d9-956588258e2f"}]}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:33:29.878712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] validate_networks() for [('072eacc7-3ff6-4869-b6d9-956588258e2f', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:33:30.273810 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:33:30.274246 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:33:30.274767 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:33:30.275187 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:33:30.275606 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:33:30.286921 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:30.287379 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:30.288295 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:30.288754 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:30.310096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:33:30.316208 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for user fb12f20385994767848ced10df127b66 and project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:33:30.384119 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:33:30.386237 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7475458b-1644-4fef-b1c5-3d181251b313',volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:33:30.807558 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9d7ddbfc-8fc5-4e41-a01d-9723364435bc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.066901 Mar 08 19:33:30.808426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 549/1103] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:33:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:33:30.818764 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6cb44e0b-2f54-4872-bd90-4ac107a6b7e3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:30.819531 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6cb44e0b-2f54-4872-bd90-4ac107a6b7e3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:30.878277 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6cb44e0b-2f54-4872-bd90-4ac107a6b7e3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:30.885240 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6cb44e0b-2f54-4872-bd90-4ac107a6b7e3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1092 microversion: 2.1 time: 0.070599 Mar 08 19:33:30.885799 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 555/1104] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:30 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:31.913912 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d0504d77-cf36-4169-ac9c-f7ef6d24fe35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:31.914576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d0504d77-cf36-4169-ac9c-f7ef6d24fe35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:31.922441 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d0504d77-cf36-4169-ac9c-f7ef6d24fe35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:31.922892 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d0504d77-cf36-4169-ac9c-f7ef6d24fe35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:31.923675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d0504d77-cf36-4169-ac9c-f7ef6d24fe35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:31.924337 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d0504d77-cf36-4169-ac9c-f7ef6d24fe35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:31.988926 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d0504d77-cf36-4169-ac9c-f7ef6d24fe35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:31.998765 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d0504d77-cf36-4169-ac9c-f7ef6d24fe35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1142 microversion: 2.1 time: 0.091332 Mar 08 19:33:31.999352 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 550/1105] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:31 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1142 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:33.015618 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-50213cc4-ca32-4571-92cd-28d53243b204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:33.016410 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-50213cc4-ca32-4571-92cd-28d53243b204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:33.026400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-50213cc4-ca32-4571-92cd-28d53243b204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:33.026400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-50213cc4-ca32-4571-92cd-28d53243b204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:33.026400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-50213cc4-ca32-4571-92cd-28d53243b204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:33.026400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-50213cc4-ca32-4571-92cd-28d53243b204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:33.150408 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-50213cc4-ca32-4571-92cd-28d53243b204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:33.162148 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-50213cc4-ca32-4571-92cd-28d53243b204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1198 microversion: 2.1 time: 0.150947 Mar 08 19:33:33.172628 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 556/1106] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:33 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1198 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:34.183280 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-eb93993b-cd39-4dbb-87e6-476998e769d1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:34.186378 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-eb93993b-cd39-4dbb-87e6-476998e769d1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:34.198690 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-eb93993b-cd39-4dbb-87e6-476998e769d1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:34.200014 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-eb93993b-cd39-4dbb-87e6-476998e769d1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:34.202385 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-eb93993b-cd39-4dbb-87e6-476998e769d1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:34.203694 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-eb93993b-cd39-4dbb-87e6-476998e769d1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:34.463070 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-eb93993b-cd39-4dbb-87e6-476998e769d1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:34.472448 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-eb93993b-cd39-4dbb-87e6-476998e769d1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1276 microversion: 2.1 time: 0.296473 Mar 08 19:33:34.473661 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 551/1107] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:34 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1276 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:33:35.138714 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-025a92f5-964b-4b26-b915-7a5e86b464ac req-edc3a2dd-15f3-4319-b997-5e75112cb848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551b0174-af37-4794-8de9-53e1b9029853", "tag": "7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:33:35.154139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-025a92f5-964b-4b26-b915-7a5e86b464ac req-edc3a2dd-15f3-4319-b997-5e75112cb848 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:35.154139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-025a92f5-964b-4b26-b915-7a5e86b464ac req-edc3a2dd-15f3-4319-b997-5e75112cb848 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:35.161083 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-025a92f5-964b-4b26-b915-7a5e86b464ac req-edc3a2dd-15f3-4319-b997-5e75112cb848 service nova] Creating event network-changed:7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63 for instance 551b0174-af37-4794-8de9-53e1b9029853 on hv-cinder-83009 Mar 08 19:33:35.166869 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-025a92f5-964b-4b26-b915-7a5e86b464ac req-edc3a2dd-15f3-4319-b997-5e75112cb848 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035635 Mar 08 19:33:35.168110 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 557/1108] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:33:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:33:35.502855 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-a565108d-32d0-4beb-afaf-6f66c793914d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:35.503464 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-a565108d-32d0-4beb-afaf-6f66c793914d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:35.510266 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a565108d-32d0-4beb-afaf-6f66c793914d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:35.510709 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a565108d-32d0-4beb-afaf-6f66c793914d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:35.511480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a565108d-32d0-4beb-afaf-6f66c793914d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:35.511937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-a565108d-32d0-4beb-afaf-6f66c793914d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:35.761250 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-a565108d-32d0-4beb-afaf-6f66c793914d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:35.772096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-a565108d-32d0-4beb-afaf-6f66c793914d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.272960 Mar 08 19:33:35.773216 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 552/1109] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:35 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:36.790914 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9a2bb17d-ca0f-4dfa-8c1b-f0acda2dfb65 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:36.791626 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9a2bb17d-ca0f-4dfa-8c1b-f0acda2dfb65 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:36.798694 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a2bb17d-ca0f-4dfa-8c1b-f0acda2dfb65 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:36.799146 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a2bb17d-ca0f-4dfa-8c1b-f0acda2dfb65 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:36.799959 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a2bb17d-ca0f-4dfa-8c1b-f0acda2dfb65 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:36.800409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a2bb17d-ca0f-4dfa-8c1b-f0acda2dfb65 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:36.952058 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9a2bb17d-ca0f-4dfa-8c1b-f0acda2dfb65 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:36.959586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9a2bb17d-ca0f-4dfa-8c1b-f0acda2dfb65 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.172923 Mar 08 19:33:36.960192 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 558/1110] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:36 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:37.976222 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-c4cee0b4-806e-498f-9881-af8b6fc9809e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:37.976841 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-c4cee0b4-806e-498f-9881-af8b6fc9809e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:37.984274 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4cee0b4-806e-498f-9881-af8b6fc9809e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:37.984723 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4cee0b4-806e-498f-9881-af8b6fc9809e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:37.985503 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4cee0b4-806e-498f-9881-af8b6fc9809e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:37.985942 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-c4cee0b4-806e-498f-9881-af8b6fc9809e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:38.124396 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-c4cee0b4-806e-498f-9881-af8b6fc9809e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:38.132003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-c4cee0b4-806e-498f-9881-af8b6fc9809e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.159647 Mar 08 19:33:38.132576 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 553/1111] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:37 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:39.149574 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-c5e8d96c-64a1-4ea7-a218-08e366527204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:39.150183 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-c5e8d96c-64a1-4ea7-a218-08e366527204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:39.157226 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5e8d96c-64a1-4ea7-a218-08e366527204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:39.168830 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5e8d96c-64a1-4ea7-a218-08e366527204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:39.168830 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5e8d96c-64a1-4ea7-a218-08e366527204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:39.168830 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-c5e8d96c-64a1-4ea7-a218-08e366527204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:39.312162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-c5e8d96c-64a1-4ea7-a218-08e366527204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:39.319649 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-c5e8d96c-64a1-4ea7-a218-08e366527204 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.174010 Mar 08 19:33:39.320256 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 559/1112] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:39 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:40.337260 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-adea8625-243b-49eb-8e7b-d8681e7f4678 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:40.337862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-adea8625-243b-49eb-8e7b-d8681e7f4678 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:40.344950 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-adea8625-243b-49eb-8e7b-d8681e7f4678 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:40.345480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-adea8625-243b-49eb-8e7b-d8681e7f4678 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:40.346165 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-adea8625-243b-49eb-8e7b-d8681e7f4678 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:40.346596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-adea8625-243b-49eb-8e7b-d8681e7f4678 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:40.502583 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-adea8625-243b-49eb-8e7b-d8681e7f4678 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:40.511770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-adea8625-243b-49eb-8e7b-d8681e7f4678 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.178120 Mar 08 19:33:40.512875 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 554/1113] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:40 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:33:41.529307 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-0c903d9b-7637-4233-bc47-4f1aa1f5d173 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:41.529941 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-0c903d9b-7637-4233-bc47-4f1aa1f5d173 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:41.536010 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c903d9b-7637-4233-bc47-4f1aa1f5d173 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:41.536463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c903d9b-7637-4233-bc47-4f1aa1f5d173 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:41.537248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c903d9b-7637-4233-bc47-4f1aa1f5d173 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:41.537682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-0c903d9b-7637-4233-bc47-4f1aa1f5d173 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:41.685485 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-0c903d9b-7637-4233-bc47-4f1aa1f5d173 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:41.692986 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-0c903d9b-7637-4233-bc47-4f1aa1f5d173 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.168028 Mar 08 19:33:41.693566 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 560/1114] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:41 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:42.710796 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4761beed-d0d7-4afa-9507-c492f3e63a18 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:42.711412 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4761beed-d0d7-4afa-9507-c492f3e63a18 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:42.718979 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4761beed-d0d7-4afa-9507-c492f3e63a18 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:42.719433 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4761beed-d0d7-4afa-9507-c492f3e63a18 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:42.720269 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4761beed-d0d7-4afa-9507-c492f3e63a18 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:42.720705 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4761beed-d0d7-4afa-9507-c492f3e63a18 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:42.870755 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4761beed-d0d7-4afa-9507-c492f3e63a18 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:42.879033 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4761beed-d0d7-4afa-9507-c492f3e63a18 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.172083 Mar 08 19:33:42.879617 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 555/1115] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:42 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:43.896899 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-174216bc-0705-4f1f-b9ea-f1c614b06fd8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:43.897498 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-174216bc-0705-4f1f-b9ea-f1c614b06fd8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:43.904652 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-174216bc-0705-4f1f-b9ea-f1c614b06fd8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:43.905110 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-174216bc-0705-4f1f-b9ea-f1c614b06fd8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:43.905887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-174216bc-0705-4f1f-b9ea-f1c614b06fd8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:43.906321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-174216bc-0705-4f1f-b9ea-f1c614b06fd8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:44.047463 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-174216bc-0705-4f1f-b9ea-f1c614b06fd8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:44.055283 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-174216bc-0705-4f1f-b9ea-f1c614b06fd8 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.162359 Mar 08 19:33:44.056162 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 561/1116] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:43 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:45.073191 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-9b14d25e-4b49-459f-9763-c5400fc57ece tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:45.073802 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-9b14d25e-4b49-459f-9763-c5400fc57ece tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:45.081080 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9b14d25e-4b49-459f-9763-c5400fc57ece tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:45.081526 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9b14d25e-4b49-459f-9763-c5400fc57ece tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:45.082292 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9b14d25e-4b49-459f-9763-c5400fc57ece tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:45.082728 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-9b14d25e-4b49-459f-9763-c5400fc57ece tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:45.224516 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-9b14d25e-4b49-459f-9763-c5400fc57ece tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:45.232770 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-9b14d25e-4b49-459f-9763-c5400fc57ece tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.163286 Mar 08 19:33:45.233356 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 556/1117] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:45 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:46.252916 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-b6c3533b-6936-4c98-809b-ee732f90887c tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:46.254095 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-b6c3533b-6936-4c98-809b-ee732f90887c tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:46.264842 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6c3533b-6936-4c98-809b-ee732f90887c tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:46.265648 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6c3533b-6936-4c98-809b-ee732f90887c tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:46.267041 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6c3533b-6936-4c98-809b-ee732f90887c tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:46.267831 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-b6c3533b-6936-4c98-809b-ee732f90887c tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:46.431189 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-b6c3533b-6936-4c98-809b-ee732f90887c tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:46.439641 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-b6c3533b-6936-4c98-809b-ee732f90887c tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.193587 Mar 08 19:33:46.440268 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 562/1118] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:46 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:47.456651 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-faac639f-9170-4644-a7b2-e10e18ae9353 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:47.457261 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-faac639f-9170-4644-a7b2-e10e18ae9353 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:47.463773 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-faac639f-9170-4644-a7b2-e10e18ae9353 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:47.464257 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-faac639f-9170-4644-a7b2-e10e18ae9353 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:47.465028 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-faac639f-9170-4644-a7b2-e10e18ae9353 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:47.466300 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-faac639f-9170-4644-a7b2-e10e18ae9353 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:47.612526 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-faac639f-9170-4644-a7b2-e10e18ae9353 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:47.620593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-faac639f-9170-4644-a7b2-e10e18ae9353 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.167842 Mar 08 19:33:47.621470 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 557/1119] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:47 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:47.888438 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-217c3e65-a9c1-4b09-bc33-a9be1defe8de req-5a33a298-2022-41ae-bda4-8485dc8af14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551b0174-af37-4794-8de9-53e1b9029853", "name": "network-vif-plugged", "status": "completed", "tag": "7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:33:47.896622 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-217c3e65-a9c1-4b09-bc33-a9be1defe8de req-5a33a298-2022-41ae-bda4-8485dc8af14f service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:47.897041 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-217c3e65-a9c1-4b09-bc33-a9be1defe8de req-5a33a298-2022-41ae-bda4-8485dc8af14f service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:47.909040 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-217c3e65-a9c1-4b09-bc33-a9be1defe8de req-5a33a298-2022-41ae-bda4-8485dc8af14f service nova] Creating event network-vif-plugged:7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63 for instance 551b0174-af37-4794-8de9-53e1b9029853 on hv-cinder-83009 Mar 08 19:33:47.914165 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-217c3e65-a9c1-4b09-bc33-a9be1defe8de req-5a33a298-2022-41ae-bda4-8485dc8af14f service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100785 Mar 08 19:33:47.914758 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 563/1120] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:33:48.643860 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-530f9cd6-7356-42ad-9434-51a6886501ed tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:48.644565 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-530f9cd6-7356-42ad-9434-51a6886501ed tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:48.651144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-530f9cd6-7356-42ad-9434-51a6886501ed tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:48.651592 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-530f9cd6-7356-42ad-9434-51a6886501ed tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:48.652394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-530f9cd6-7356-42ad-9434-51a6886501ed tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:48.653550 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-530f9cd6-7356-42ad-9434-51a6886501ed tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:48.803498 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-530f9cd6-7356-42ad-9434-51a6886501ed tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:48.811721 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-530f9cd6-7356-42ad-9434-51a6886501ed tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1264 microversion: 2.1 time: 0.171617 Mar 08 19:33:48.812344 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 558/1121] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:48 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:49.830327 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-d7f4d538-034f-4cfd-bcc8-f266c143dff7 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:49.831023 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-d7f4d538-034f-4cfd-bcc8-f266c143dff7 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:49.842970 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d7f4d538-034f-4cfd-bcc8-f266c143dff7 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:49.843957 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d7f4d538-034f-4cfd-bcc8-f266c143dff7 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:49.845118 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d7f4d538-034f-4cfd-bcc8-f266c143dff7 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:49.845575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-d7f4d538-034f-4cfd-bcc8-f266c143dff7 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:49.986561 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-d7f4d538-034f-4cfd-bcc8-f266c143dff7 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:49.994549 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-d7f4d538-034f-4cfd-bcc8-f266c143dff7 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1452 microversion: 2.1 time: 0.168844 Mar 08 19:33:49.995139 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 564/1122] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:49 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:33:50.011523 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-6ef32c68-5ef6-4d96-a367-8386c4dde98d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:33:50.012406 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-6ef32c68-5ef6-4d96-a367-8386c4dde98d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:33:50.018787 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6ef32c68-5ef6-4d96-a367-8386c4dde98d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:50.019234 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6ef32c68-5ef6-4d96-a367-8386c4dde98d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:50.020049 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6ef32c68-5ef6-4d96-a367-8386c4dde98d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:50.020482 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-6ef32c68-5ef6-4d96-a367-8386c4dde98d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:50.172317 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-6ef32c68-5ef6-4d96-a367-8386c4dde98d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:33:50.180220 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-6ef32c68-5ef6-4d96-a367-8386c4dde98d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1452 microversion: 2.1 time: 0.172494 Mar 08 19:33:50.180814 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 559/1123] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:33:50 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:33:51.669670 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:33:51.670329 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:33:52.177118 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-73b4748d-cc6a-40a8-b979-961c6231459f req-98b77dc4-5f6b-424d-8c4e-b20ce6d60aa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551b0174-af37-4794-8de9-53e1b9029853", "tag": "7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:33:52.185848 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-73b4748d-cc6a-40a8-b979-961c6231459f req-98b77dc4-5f6b-424d-8c4e-b20ce6d60aa7 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:33:52.186288 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-73b4748d-cc6a-40a8-b979-961c6231459f req-98b77dc4-5f6b-424d-8c4e-b20ce6d60aa7 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:33:52.197481 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-73b4748d-cc6a-40a8-b979-961c6231459f req-98b77dc4-5f6b-424d-8c4e-b20ce6d60aa7 service nova] Creating event network-changed:7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63 for instance 551b0174-af37-4794-8de9-53e1b9029853 on hv-cinder-83009 Mar 08 19:33:52.203157 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-73b4748d-cc6a-40a8-b979-961c6231459f req-98b77dc4-5f6b-424d-8c4e-b20ce6d60aa7 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029679 Mar 08 19:33:52.203743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 565/1124] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:33:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:35:16.607957 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:35:16.608701 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:35:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:35:23.213375 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:35:23.213375 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:35:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:35:35.872584 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:35:35.873144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:35:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:35:52.783023 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1585017107", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-693581338", "security_groups": [{"name": "tempest-secgroup-smoke-1260733439"}], "block_device_mapping_v2": [{"uuid": "de42c20e-d784-4257-b569-e5f93127f23a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "072eacc7-3ff6-4869-b6d9-956588258e2f"}]}} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:35:52.956084 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.network.neutron [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] validate_networks() for [('072eacc7-3ff6-4869-b6d9-956588258e2f', None, None, None, None, None)] {{(pid=117390) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 08 19:35:53.378890 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Flavor limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 08 19:35:53.379319 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Image limits 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 08 19:35:53.379786 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Flavor pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 08 19:35:53.380301 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Image pref 0:0:0 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 08 19:35:53.380736 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.virt.hardware [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117390) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 08 19:35:53.389764 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:53.390207 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:53.391000 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:53.391434 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:53.407632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 08 19:35:53.411304 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.quota [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Getting quotas for user fb12f20385994767848ced10df127b66 and project 20e8b5f15db44609b06e2e7de694ebd8. Resources: {'cores', 'instances', 'ram'} {{(pid=117390) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 08 19:35:53.467118 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Going to run 1 instances... {{(pid=117390) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 08 19:35:53.469201 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='de42c20e-d784-4257-b569-e5f93127f23a',volume_size=None,volume_type=None)] {{(pid=117390) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 08 19:35:53.885258 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0d4df5f2-3152-49a5-a0ce-660ccd88a145 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.106826 Mar 08 19:35:53.886585 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 560/1125] 10.222.0.75 () {60 vars in 1146 bytes} [Tue Mar 8 19:35:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 08 19:35:53.894813 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3536b6dc-0d80-4f52-a40f-181618486b7c] AMQP server on 10.222.0.75:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 08 19:35:53.898892 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-1c928a79-acd6-4d77-b4a6-314c3131b036 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:35:53.899586 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-1c928a79-acd6-4d77-b4a6-314c3131b036 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:35:54.288359 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-1c928a79-acd6-4d77-b4a6-314c3131b036 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:35:54.297168 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-1c928a79-acd6-4d77-b4a6-314c3131b036 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1094 microversion: 2.1 time: 0.404017 Mar 08 19:35:54.299169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 566/1126] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:35:53 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1094 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:35:55.320506 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-e2d3368a-69ed-4dec-bffc-07fc0d3e7ad9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:35:55.321207 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-e2d3368a-69ed-4dec-bffc-07fc0d3e7ad9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:35:55.329659 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e2d3368a-69ed-4dec-bffc-07fc0d3e7ad9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:55.329659 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e2d3368a-69ed-4dec-bffc-07fc0d3e7ad9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:55.330603 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e2d3368a-69ed-4dec-bffc-07fc0d3e7ad9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:55.331022 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-e2d3368a-69ed-4dec-bffc-07fc0d3e7ad9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:55.392627 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-e2d3368a-69ed-4dec-bffc-07fc0d3e7ad9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:35:55.399940 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-e2d3368a-69ed-4dec-bffc-07fc0d3e7ad9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1136 microversion: 2.1 time: 0.089316 Mar 08 19:35:55.400716 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 561/1127] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:35:55 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1136 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:35:56.423939 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ef33c0c3-df1e-4484-9ed7-9d1907bdfbbc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:35:56.424635 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ef33c0c3-df1e-4484-9ed7-9d1907bdfbbc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:35:56.433873 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ef33c0c3-df1e-4484-9ed7-9d1907bdfbbc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:56.444887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ef33c0c3-df1e-4484-9ed7-9d1907bdfbbc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:56.444887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ef33c0c3-df1e-4484-9ed7-9d1907bdfbbc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:56.444887 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ef33c0c3-df1e-4484-9ed7-9d1907bdfbbc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:56.460682 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] [3536b6dc-0d80-4f52-a40f-181618486b7c] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54812. Mar 08 19:35:56.532621 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ef33c0c3-df1e-4484-9ed7-9d1907bdfbbc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:35:56.539901 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ef33c0c3-df1e-4484-9ed7-9d1907bdfbbc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1210 microversion: 2.1 time: 0.120051 Mar 08 19:35:56.546107 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 567/1128] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:35:56 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1210 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:35:57.567003 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-0e078a5b-94f4-49fd-bcf0-777141117798 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:35:57.567612 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-0e078a5b-94f4-49fd-bcf0-777141117798 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:35:57.574468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0e078a5b-94f4-49fd-bcf0-777141117798 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:57.574916 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0e078a5b-94f4-49fd-bcf0-777141117798 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:57.575684 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0e078a5b-94f4-49fd-bcf0-777141117798 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:57.576323 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-0e078a5b-94f4-49fd-bcf0-777141117798 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:57.817937 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-0e078a5b-94f4-49fd-bcf0-777141117798 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:35:57.827279 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-0e078a5b-94f4-49fd-bcf0-777141117798 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1278 microversion: 2.1 time: 0.264095 Mar 08 19:35:57.827853 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 562/1129] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:35:57 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1278 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:35:58.033943 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-b8336bf3-4ac1-4498-9b2e-3308b7d7c805 req-4cd53134-22b1-45c8-84a3-7286034d692a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7526d2c-2f06-43f2-a3ec-99f151e3b6c4", "tag": "78b26457-3dae-4a26-8682-9461b7aefcd3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:35:58.049318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-b8336bf3-4ac1-4498-9b2e-3308b7d7c805 req-4cd53134-22b1-45c8-84a3-7286034d692a service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:58.049318 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-b8336bf3-4ac1-4498-9b2e-3308b7d7c805 req-4cd53134-22b1-45c8-84a3-7286034d692a service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:58.059671 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-b8336bf3-4ac1-4498-9b2e-3308b7d7c805 req-4cd53134-22b1-45c8-84a3-7286034d692a service nova] Creating event network-changed:78b26457-3dae-4a26-8682-9461b7aefcd3 for instance b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 on hv-cinder-83009 Mar 08 19:35:58.065677 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-b8336bf3-4ac1-4498-9b2e-3308b7d7c805 req-4cd53134-22b1-45c8-84a3-7286034d692a service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109066 Mar 08 19:35:58.066372 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 568/1130] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:35:58.845032 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4e97ea41-3aae-4cce-b9f1-00eb31474d35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:35:58.845702 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4e97ea41-3aae-4cce-b9f1-00eb31474d35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:35:58.852451 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4e97ea41-3aae-4cce-b9f1-00eb31474d35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:58.852895 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4e97ea41-3aae-4cce-b9f1-00eb31474d35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:58.853667 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4e97ea41-3aae-4cce-b9f1-00eb31474d35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:35:58.854096 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4e97ea41-3aae-4cce-b9f1-00eb31474d35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:35:59.113615 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-4e97ea41-3aae-4cce-b9f1-00eb31474d35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:35:59.121606 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4e97ea41-3aae-4cce-b9f1-00eb31474d35 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.280610 Mar 08 19:35:59.122073 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 563/1131] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:35:58 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:36:00.146663 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a6597741-fb4d-4e3e-a5a9-d2e1ca3510fc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:00.147368 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a6597741-fb4d-4e3e-a5a9-d2e1ca3510fc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:00.154658 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a6597741-fb4d-4e3e-a5a9-d2e1ca3510fc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:00.155106 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a6597741-fb4d-4e3e-a5a9-d2e1ca3510fc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:00.155960 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a6597741-fb4d-4e3e-a5a9-d2e1ca3510fc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:00.156401 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a6597741-fb4d-4e3e-a5a9-d2e1ca3510fc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:00.298321 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a6597741-fb4d-4e3e-a5a9-d2e1ca3510fc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:00.306129 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a6597741-fb4d-4e3e-a5a9-d2e1ca3510fc tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.164141 Mar 08 19:36:00.306692 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 569/1132] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:00 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:01.322778 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-d2eea5ad-53d2-41cf-9208-eddc9c6155b9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:01.323368 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-d2eea5ad-53d2-41cf-9208-eddc9c6155b9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:01.329829 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2eea5ad-53d2-41cf-9208-eddc9c6155b9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:01.330328 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2eea5ad-53d2-41cf-9208-eddc9c6155b9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:01.331103 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2eea5ad-53d2-41cf-9208-eddc9c6155b9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:01.331537 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-d2eea5ad-53d2-41cf-9208-eddc9c6155b9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:01.472381 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-d2eea5ad-53d2-41cf-9208-eddc9c6155b9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:01.480656 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-d2eea5ad-53d2-41cf-9208-eddc9c6155b9 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.160956 Mar 08 19:36:01.481227 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 564/1133] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:01 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:02.498555 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-ee16039c-6db0-44d4-8272-d293d4610eca tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:02.499178 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-ee16039c-6db0-44d4-8272-d293d4610eca tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:02.505779 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ee16039c-6db0-44d4-8272-d293d4610eca tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:02.506237 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ee16039c-6db0-44d4-8272-d293d4610eca tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:02.507069 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ee16039c-6db0-44d4-8272-d293d4610eca tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:02.507648 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-ee16039c-6db0-44d4-8272-d293d4610eca tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:02.643206 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-ee16039c-6db0-44d4-8272-d293d4610eca tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:02.650498 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-ee16039c-6db0-44d4-8272-d293d4610eca tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.156597 Mar 08 19:36:02.651061 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 570/1134] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:02 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:36:03.667607 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-51e81688-af5c-4538-b805-a67d08ab66c6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:03.668245 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-51e81688-af5c-4538-b805-a67d08ab66c6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:03.674710 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-51e81688-af5c-4538-b805-a67d08ab66c6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:03.675153 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-51e81688-af5c-4538-b805-a67d08ab66c6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:03.675939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-51e81688-af5c-4538-b805-a67d08ab66c6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:03.676367 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-51e81688-af5c-4538-b805-a67d08ab66c6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:03.813063 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-51e81688-af5c-4538-b805-a67d08ab66c6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:03.820374 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-51e81688-af5c-4538-b805-a67d08ab66c6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.157015 Mar 08 19:36:03.820926 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 565/1135] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:03 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:04.837323 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-7f5cfe2c-0471-4cce-838a-a7c2a2c9a2dd tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:04.837937 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-7f5cfe2c-0471-4cce-838a-a7c2a2c9a2dd tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:04.844851 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7f5cfe2c-0471-4cce-838a-a7c2a2c9a2dd tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:04.845308 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7f5cfe2c-0471-4cce-838a-a7c2a2c9a2dd tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:04.846086 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7f5cfe2c-0471-4cce-838a-a7c2a2c9a2dd tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:04.846523 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-7f5cfe2c-0471-4cce-838a-a7c2a2c9a2dd tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:04.990088 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-7f5cfe2c-0471-4cce-838a-a7c2a2c9a2dd tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:04.998563 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-7f5cfe2c-0471-4cce-838a-a7c2a2c9a2dd tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.165219 Mar 08 19:36:04.999135 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 571/1136] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:04 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:06.015939 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-27722bc5-1470-4d6b-ae52-ded2184c10e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:06.016512 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-27722bc5-1470-4d6b-ae52-ded2184c10e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:06.023126 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27722bc5-1470-4d6b-ae52-ded2184c10e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:06.023574 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27722bc5-1470-4d6b-ae52-ded2184c10e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:06.024370 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27722bc5-1470-4d6b-ae52-ded2184c10e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:06.024800 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-27722bc5-1470-4d6b-ae52-ded2184c10e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:06.166187 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-27722bc5-1470-4d6b-ae52-ded2184c10e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:06.174355 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-27722bc5-1470-4d6b-ae52-ded2184c10e6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.163107 Mar 08 19:36:06.174918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 566/1137] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:06 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:07.195385 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-21d3d947-9a5c-48fc-9734-a8af0e3def7b tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:07.196493 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-21d3d947-9a5c-48fc-9734-a8af0e3def7b tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:07.206021 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-21d3d947-9a5c-48fc-9734-a8af0e3def7b tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:07.206474 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-21d3d947-9a5c-48fc-9734-a8af0e3def7b tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:07.207276 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-21d3d947-9a5c-48fc-9734-a8af0e3def7b tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:07.207717 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-21d3d947-9a5c-48fc-9734-a8af0e3def7b tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:07.355645 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-21d3d947-9a5c-48fc-9734-a8af0e3def7b tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:07.364552 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-21d3d947-9a5c-48fc-9734-a8af0e3def7b tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.176407 Mar 08 19:36:07.365166 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 572/1138] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:07 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:08.382345 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-aa7ccb6d-9a20-456e-b632-e3294b910e62 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:08.382964 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-aa7ccb6d-9a20-456e-b632-e3294b910e62 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:08.390249 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa7ccb6d-9a20-456e-b632-e3294b910e62 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:08.390709 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa7ccb6d-9a20-456e-b632-e3294b910e62 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:08.391488 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa7ccb6d-9a20-456e-b632-e3294b910e62 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:08.391958 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-aa7ccb6d-9a20-456e-b632-e3294b910e62 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:08.533124 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-aa7ccb6d-9a20-456e-b632-e3294b910e62 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:08.541232 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-aa7ccb6d-9a20-456e-b632-e3294b910e62 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.162807 Mar 08 19:36:08.551869 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 567/1139] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:08 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:08.622447 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-18ced114-af77-41fb-907d-6216d153aa2c req-8fd90d0b-0536-4980-8529-deab12e06afe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7526d2c-2f06-43f2-a3ec-99f151e3b6c4", "name": "network-vif-plugged", "status": "completed", "tag": "78b26457-3dae-4a26-8682-9461b7aefcd3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:36:08.630951 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-18ced114-af77-41fb-907d-6216d153aa2c req-8fd90d0b-0536-4980-8529-deab12e06afe service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:08.631400 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-18ced114-af77-41fb-907d-6216d153aa2c req-8fd90d0b-0536-4980-8529-deab12e06afe service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:08.643134 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-18ced114-af77-41fb-907d-6216d153aa2c req-8fd90d0b-0536-4980-8529-deab12e06afe service nova] Creating event network-vif-plugged:78b26457-3dae-4a26-8682-9461b7aefcd3 for instance b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 on hv-cinder-83009 Mar 08 19:36:08.648232 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-18ced114-af77-41fb-907d-6216d153aa2c req-8fd90d0b-0536-4980-8529-deab12e06afe service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030780 Mar 08 19:36:08.648809 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 573/1140] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:36:09.560490 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5233b212-2ead-4bd2-958b-7569b4c81a2d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:09.561153 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5233b212-2ead-4bd2-958b-7569b4c81a2d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:09.569226 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5233b212-2ead-4bd2-958b-7569b4c81a2d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:09.570053 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5233b212-2ead-4bd2-958b-7569b4c81a2d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:09.571460 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5233b212-2ead-4bd2-958b-7569b4c81a2d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:09.572175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5233b212-2ead-4bd2-958b-7569b4c81a2d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:09.743629 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-5233b212-2ead-4bd2-958b-7569b4c81a2d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:09.752175 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5233b212-2ead-4bd2-958b-7569b4c81a2d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1266 microversion: 2.1 time: 0.196369 Mar 08 19:36:09.752745 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 568/1141] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:09 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:36:10.773124 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-f4141155-8102-41fa-901e-8dc991848d63 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:10.773823 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-f4141155-8102-41fa-901e-8dc991848d63 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:10.781123 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f4141155-8102-41fa-901e-8dc991848d63 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:10.781568 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f4141155-8102-41fa-901e-8dc991848d63 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:10.782342 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f4141155-8102-41fa-901e-8dc991848d63 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:10.782773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-f4141155-8102-41fa-901e-8dc991848d63 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:10.919663 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-f4141155-8102-41fa-901e-8dc991848d63 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:10.927274 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-f4141155-8102-41fa-901e-8dc991848d63 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1454 microversion: 2.1 time: 0.158785 Mar 08 19:36:10.927846 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 574/1142] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:10 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1454 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:10.942982 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-b8d71a08-bf13-4ea5-9e0f-d1a9c3f9a0da tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:36:10.943630 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-b8d71a08-bf13-4ea5-9e0f-d1a9c3f9a0da tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:36:10.950849 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8d71a08-bf13-4ea5-9e0f-d1a9c3f9a0da tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:10.951311 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8d71a08-bf13-4ea5-9e0f-d1a9c3f9a0da tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:10.952119 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8d71a08-bf13-4ea5-9e0f-d1a9c3f9a0da tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:10.952583 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-b8d71a08-bf13-4ea5-9e0f-d1a9c3f9a0da tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:11.092593 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-b8d71a08-bf13-4ea5-9e0f-d1a9c3f9a0da tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:36:11.099911 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-b8d71a08-bf13-4ea5-9e0f-d1a9c3f9a0da tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1454 microversion: 2.1 time: 0.160855 Mar 08 19:36:11.100495 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 569/1143] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:36:10 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:36:13.489720 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-069c637c-4912-4216-b9af-a718ebf08537 req-f0350f32-5b3b-484c-930a-5a56530c8270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7526d2c-2f06-43f2-a3ec-99f151e3b6c4", "tag": "78b26457-3dae-4a26-8682-9461b7aefcd3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:36:13.499733 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-069c637c-4912-4216-b9af-a718ebf08537 req-f0350f32-5b3b-484c-930a-5a56530c8270 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:36:13.500575 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-069c637c-4912-4216-b9af-a718ebf08537 req-f0350f32-5b3b-484c-930a-5a56530c8270 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:36:13.515014 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-069c637c-4912-4216-b9af-a718ebf08537 req-f0350f32-5b3b-484c-930a-5a56530c8270 service nova] Creating event network-changed:78b26457-3dae-4a26-8682-9461b7aefcd3 for instance b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 on hv-cinder-83009 Mar 08 19:36:13.520215 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-069c637c-4912-4216-b9af-a718ebf08537 req-f0350f32-5b3b-484c-930a-5a56530c8270 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034723 Mar 08 19:36:13.520837 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 575/1144] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:36:44.658287 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:36:44.659042 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:36:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:37:11.677948 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:37:11.678763 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:38:03.410087 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3536b6dc-0d80-4f52-a40f-181618486b7c] AMQP server on 10.222.0.75:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Mar 08 19:38:03.415627 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-7786ecf1-9022-4a00-80ed-d9e34825823e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:03.417023 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7786ecf1-9022-4a00-80ed-d9e34825823e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:03.423400 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7786ecf1-9022-4a00-80ed-d9e34825823e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:03.424745 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7786ecf1-9022-4a00-80ed-d9e34825823e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:03.425546 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7786ecf1-9022-4a00-80ed-d9e34825823e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:03.425984 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-7786ecf1-9022-4a00-80ed-d9e34825823e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:03.451426 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-7786ecf1-9022-4a00-80ed-d9e34825823e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Going to try to terminate instance {{(pid=117390) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:38:03.512548 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-ccb646c8-1468-4c2f-a693-0b5be26da30d req-f93830dc-a6ef-49e3-a635-e2b3b75abef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7526d2c-2f06-43f2-a3ec-99f151e3b6c4", "tag": "78b26457-3dae-4a26-8682-9461b7aefcd3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:38:03.520709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ccb646c8-1468-4c2f-a693-0b5be26da30d req-f93830dc-a6ef-49e3-a635-e2b3b75abef0 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:03.521149 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-ccb646c8-1468-4c2f-a693-0b5be26da30d req-f93830dc-a6ef-49e3-a635-e2b3b75abef0 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:03.532448 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-ccb646c8-1468-4c2f-a693-0b5be26da30d req-f93830dc-a6ef-49e3-a635-e2b3b75abef0 service nova] Creating event network-changed:78b26457-3dae-4a26-8682-9461b7aefcd3 for instance b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 on hv-cinder-83009 Mar 08 19:38:03.538333 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-ccb646c8-1468-4c2f-a693-0b5be26da30d req-f93830dc-a6ef-49e3-a635-e2b3b75abef0 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130758 Mar 08 19:38:03.538910 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 576/1145] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:38:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 08 19:38:03.811059 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-7786ecf1-9022-4a00-80ed-d9e34825823e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "DELETE /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 204 len: 0 microversion: 2.1 time: 0.405850 Mar 08 19:38:03.811957 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 570/1146] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:38:03 2022] DELETE /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:38:03.822113 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-6dff5a78-ed91-494b-a93d-4e57a70acfb6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:03.823169 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-6dff5a78-ed91-494b-a93d-4e57a70acfb6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:03.830709 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6dff5a78-ed91-494b-a93d-4e57a70acfb6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:03.831504 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6dff5a78-ed91-494b-a93d-4e57a70acfb6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:03.832570 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6dff5a78-ed91-494b-a93d-4e57a70acfb6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:03.833206 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-6dff5a78-ed91-494b-a93d-4e57a70acfb6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:04.071708 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-6dff5a78-ed91-494b-a93d-4e57a70acfb6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:38:04.079553 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-6dff5a78-ed91-494b-a93d-4e57a70acfb6 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1577 microversion: 2.1 time: 0.261996 Mar 08 19:38:04.083847 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 577/1147] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:03 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1577 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:38:05.098394 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-1ba11b97-3583-4080-b587-a17c01ab0dc3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:05.099129 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-1ba11b97-3583-4080-b587-a17c01ab0dc3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:05.105918 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ba11b97-3583-4080-b587-a17c01ab0dc3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:05.106365 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ba11b97-3583-4080-b587-a17c01ab0dc3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:05.107130 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ba11b97-3583-4080-b587-a17c01ab0dc3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:05.107561 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-1ba11b97-3583-4080-b587-a17c01ab0dc3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:05.244465 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-1ba11b97-3583-4080-b587-a17c01ab0dc3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:38:05.252108 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-1ba11b97-3583-4080-b587-a17c01ab0dc3 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1460 microversion: 2.1 time: 0.158401 Mar 08 19:38:05.252675 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 571/1148] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:05 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1460 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:38:06.193704 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [req-80db2a2f-812e-4719-8362-d7eaa13e987d req-78830e29-83fa-4107-b6b5-eaf27bb72561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7526d2c-2f06-43f2-a3ec-99f151e3b6c4", "name": "network-vif-deleted", "tag": "78b26457-3dae-4a26-8682-9461b7aefcd3"}]} {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:38:06.204831 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] [3536b6dc-0d80-4f52-a40f-181618486b7c] Reconnected to AMQP server on 10.222.0.75:5672 via [amqp] client with port 54914. Mar 08 19:38:06.210995 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-80db2a2f-812e-4719-8362-d7eaa13e987d req-78830e29-83fa-4107-b6b5-eaf27bb72561 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:06.211435 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [req-80db2a2f-812e-4719-8362-d7eaa13e987d req-78830e29-83fa-4107-b6b5-eaf27bb72561 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:06.223344 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.compute.server_external_events [req-80db2a2f-812e-4719-8362-d7eaa13e987d req-78830e29-83fa-4107-b6b5-eaf27bb72561 service nova] Creating event network-vif-deleted:78b26457-3dae-4a26-8682-9461b7aefcd3 for instance b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 on hv-cinder-83009 Mar 08 19:38:06.228765 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [req-80db2a2f-812e-4719-8362-d7eaa13e987d req-78830e29-83fa-4107-b6b5-eaf27bb72561 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039628 Mar 08 19:38:06.229598 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 578/1149] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:38:06.268989 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-df5fcf8e-f216-47e8-8ac4-052cde1a938d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:06.269704 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-df5fcf8e-f216-47e8-8ac4-052cde1a938d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:06.276177 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-df5fcf8e-f216-47e8-8ac4-052cde1a938d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:06.276674 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-df5fcf8e-f216-47e8-8ac4-052cde1a938d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:06.277439 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-df5fcf8e-f216-47e8-8ac4-052cde1a938d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:06.277867 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-df5fcf8e-f216-47e8-8ac4-052cde1a938d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:06.337712 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-df5fcf8e-f216-47e8-8ac4-052cde1a938d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:38:06.345118 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-df5fcf8e-f216-47e8-8ac4-052cde1a938d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1392 microversion: 2.1 time: 0.080189 Mar 08 19:38:06.346198 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 572/1150] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:06 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1392 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:38:07.364912 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:07.364912 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:07.377902 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:07.378558 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:07.379470 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:07.379881 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:07.411247 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:07.411689 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:07.412160 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.objects.instance [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lazy-loading 'fault' on Instance uuid b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 {{(pid=117391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 08 19:38:07.452231 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:38:07.460248 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9a4cd770-ffc5-4743-8b86-0c15ab87bc5f tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 200 len: 1230 microversion: 2.1 time: 0.101468 Mar 08 19:38:07.460806 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 579/1151] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:07 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:38:08.477500 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:08.478144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: b7526d2c-2f06-43f2-a3ec-99f151e3b6c4] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:08.484783 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:08.485236 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:08.486058 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:08.486888 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:08.500039 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] HTTP exception thrown: Instance b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 could not be found. Mar 08 19:38:08.500646 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Returning 404 to user: Instance b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:38:08.502035 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-4951e8ba-55f4-4926-85a4-3bdb00e3d26d tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4" status: 404 len: 111 microversion: 2.1 time: 0.027943 Mar 08 19:38:08.502762 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 573/1152] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:08 2022] GET /compute/v2.1/servers/b7526d2c-2f06-43f2-a3ec-99f151e3b6c4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:38:12.123109 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-048e2baf-8dfc-4e4f-b90e-0e4493a1c7cf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:12.123640 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-048e2baf-8dfc-4e4f-b90e-0e4493a1c7cf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:12.126227 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-15a42cff-9f13-4fb8-8921-80a215083f45 req-7f99d831-6322-4775-af65-b66c71726c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "551b0174-af37-4794-8de9-53e1b9029853", "tag": "7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:38:12.131096 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-048e2baf-8dfc-4e4f-b90e-0e4493a1c7cf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:12.131545 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-048e2baf-8dfc-4e4f-b90e-0e4493a1c7cf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:12.132585 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-048e2baf-8dfc-4e4f-b90e-0e4493a1c7cf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:12.133025 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-048e2baf-8dfc-4e4f-b90e-0e4493a1c7cf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:12.137070 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-15a42cff-9f13-4fb8-8921-80a215083f45 req-7f99d831-6322-4775-af65-b66c71726c39 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:12.137596 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-15a42cff-9f13-4fb8-8921-80a215083f45 req-7f99d831-6322-4775-af65-b66c71726c39 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:12.149437 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-15a42cff-9f13-4fb8-8921-80a215083f45 req-7f99d831-6322-4775-af65-b66c71726c39 service nova] Creating event network-changed:7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63 for instance 551b0174-af37-4794-8de9-53e1b9029853 on hv-cinder-83009 Mar 08 19:38:12.154845 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-15a42cff-9f13-4fb8-8921-80a215083f45 req-7f99d831-6322-4775-af65-b66c71726c39 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033040 Mar 08 19:38:12.155651 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 574/1153] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:38:12.161598 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-048e2baf-8dfc-4e4f-b90e-0e4493a1c7cf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Going to try to terminate instance {{(pid=117391) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 08 19:38:12.474577 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-048e2baf-8dfc-4e4f-b90e-0e4493a1c7cf tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "DELETE /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 204 len: 0 microversion: 2.1 time: 0.354944 Mar 08 19:38:12.475552 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 580/1154] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:38:12 2022] DELETE /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 08 19:38:12.485335 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-bf234ff9-825f-4589-90bc-f2ee7fa030f1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:12.486256 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-bf234ff9-825f-4589-90bc-f2ee7fa030f1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:12.493642 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bf234ff9-825f-4589-90bc-f2ee7fa030f1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:12.494093 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bf234ff9-825f-4589-90bc-f2ee7fa030f1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:12.495144 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bf234ff9-825f-4589-90bc-f2ee7fa030f1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:12.495646 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-bf234ff9-825f-4589-90bc-f2ee7fa030f1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:12.718079 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.policy [None req-bf234ff9-825f-4589-90bc-f2ee7fa030f1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117390) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:38:12.732054 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-bf234ff9-825f-4589-90bc-f2ee7fa030f1 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1577 microversion: 2.1 time: 0.251927 Mar 08 19:38:12.732632 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 575/1155] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:12 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1577 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:38:13.750672 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-cfd9e61a-7748-4eca-8913-8cdd96868975 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:13.751409 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-cfd9e61a-7748-4eca-8913-8cdd96868975 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:13.757885 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cfd9e61a-7748-4eca-8913-8cdd96868975 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:13.758335 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cfd9e61a-7748-4eca-8913-8cdd96868975 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:13.759098 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cfd9e61a-7748-4eca-8913-8cdd96868975 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:13.759534 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-cfd9e61a-7748-4eca-8913-8cdd96868975 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:13.907423 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-cfd9e61a-7748-4eca-8913-8cdd96868975 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:38:13.915377 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-cfd9e61a-7748-4eca-8913-8cdd96868975 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1458 microversion: 2.1 time: 0.168976 Mar 08 19:38:13.915964 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 581/1156] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:13 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 08 19:38:14.737179 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [req-4acda5d4-36a0-4ba7-bea7-f179103bc65d req-a7338236-abc2-4c40-bfe4-fdc415bd1247 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "551b0174-af37-4794-8de9-53e1b9029853", "name": "network-vif-deleted", "tag": "7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63"}]} {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 08 19:38:14.745797 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-4acda5d4-36a0-4ba7-bea7-f179103bc65d req-a7338236-abc2-4c40-bfe4-fdc415bd1247 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:14.746232 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [req-4acda5d4-36a0-4ba7-bea7-f179103bc65d req-a7338236-abc2-4c40-bfe4-fdc415bd1247 service nova] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:14.757439 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.compute.server_external_events [req-4acda5d4-36a0-4ba7-bea7-f179103bc65d req-a7338236-abc2-4c40-bfe4-fdc415bd1247 service nova] Creating event network-vif-deleted:7ccc7cd1-654d-4d1c-81bf-45c5ce0a7a63 for instance 551b0174-af37-4794-8de9-53e1b9029853 on hv-cinder-83009 Mar 08 19:38:14.762830 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [req-4acda5d4-36a0-4ba7-bea7-f179103bc65d req-a7338236-abc2-4c40-bfe4-fdc415bd1247 service nova] 10.222.0.75 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029510 Mar 08 19:38:14.763404 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 576/1157] 10.222.0.75 () {64 vars in 1317 bytes} [Tue Mar 8 19:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 08 19:38:14.932716 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-a73414b7-51d3-44a9-89fb-c123818bc61e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:14.933373 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-a73414b7-51d3-44a9-89fb-c123818bc61e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:14.939623 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a73414b7-51d3-44a9-89fb-c123818bc61e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:14.940108 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a73414b7-51d3-44a9-89fb-c123818bc61e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:14.940921 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a73414b7-51d3-44a9-89fb-c123818bc61e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:14.941356 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-a73414b7-51d3-44a9-89fb-c123818bc61e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:15.003208 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.policy [None req-a73414b7-51d3-44a9-89fb-c123818bc61e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fb12f20385994767848ced10df127b66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20e8b5f15db44609b06e2e7de694ebd8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117391) authorize /opt/stack/nova/nova/policy.py:199}} Mar 08 19:38:15.011554 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-a73414b7-51d3-44a9-89fb-c123818bc61e tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 200 len: 1223 microversion: 2.1 time: 0.082646 Mar 08 19:38:15.012164 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 582/1158] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:14 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 08 19:38:16.029123 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:16.029819 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: 551b0174-af37-4794-8de9-53e1b9029853] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:16.036331 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:16.040162 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:16.040162 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:16.040162 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:16.050893 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] HTTP exception thrown: Instance 551b0174-af37-4794-8de9-53e1b9029853 could not be found. Mar 08 19:38:16.051480 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Returning 404 to user: Instance 551b0174-af37-4794-8de9-53e1b9029853 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:38:16.052392 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-5fe33f5b-6632-4c16-9f37-7d18a76cb6e0 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853" status: 404 len: 111 microversion: 2.1 time: 0.027536 Mar 08 19:38:16.052914 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 577/1159] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:16 2022] GET /compute/v2.1/servers/551b0174-af37-4794-8de9-53e1b9029853 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:38:16.594265 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:16.594773 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.compute.api [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117391) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:16.602149 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:16.602600 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:16.603359 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:16.603795 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG oslo_concurrency.lockutils [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:16.617213 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.wsgi [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] HTTP exception thrown: Instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 could not be found. Mar 08 19:38:16.617795 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Returning 404 to user: Instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 could not be found. {{(pid=117391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:38:16.618637 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-9d009854-8c46-4da7-bb87-134b7b848f48 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "DELETE /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 404 len: 111 microversion: 2.1 time: 0.028253 Mar 08 19:38:16.619166 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 583/1160] 10.222.0.75 () {58 vars in 1238 bytes} [Tue Mar 8 19:38:16 2022] DELETE /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 08 19:38:16.627122 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '>' {{(pid=117390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:16.628326 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.compute.api [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] [instance: ffbe5786-888f-49ea-bfeb-503e7d4433b8] Fetching instance by UUID {{(pid=117390) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 08 19:38:16.634106 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:16.634550 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:16.635311 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 08 19:38:16.635827 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG oslo_concurrency.lockutils [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Lock "54c5021f-2f67-450e-b2bf-a7af4b069dbb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 08 19:38:16.649924 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.wsgi [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] HTTP exception thrown: Instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 could not be found. Mar 08 19:38:16.650509 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: DEBUG nova.api.openstack.wsgi [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Returning 404 to user: Instance ffbe5786-888f-49ea-bfeb-503e7d4433b8 could not be found. {{(pid=117390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 08 19:38:16.651331 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO nova.api.openstack.requestlog [None req-f1c48051-c00a-4095-b326-ffd0bc978503 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8" status: 404 len: 111 microversion: 2.1 time: 0.028025 Mar 08 19:38:16.651880 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: [pid: 117390|app: 0|req: 578/1161] 10.222.0.75 () {58 vars in 1235 bytes} [Tue Mar 8 19:38:16 2022] GET /compute/v2.1/servers/ffbe5786-888f-49ea-bfeb-503e7d4433b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 08 19:38:18.232819 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: DEBUG nova.api.openstack.wsgi [None req-249cf2a3-739c-439a-ad46-e30e1b9d9b38 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] Calling method '.version_select at 0x7f4383f0a940>' {{(pid=117391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 08 19:38:18.336939 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO nova.api.openstack.requestlog [None req-249cf2a3-739c-439a-ad46-e30e1b9d9b38 tempest-TestVolumeBootPattern-1666025159 tempest-TestVolumeBootPattern-1666025159-project] 10.222.0.75 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-693581338" status: 202 len: 0 microversion: 2.1 time: 0.107904 Mar 08 19:38:18.337512 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: [pid: 117391|app: 0|req: 584/1162] 10.222.0.75 () {58 vars in 1259 bytes} [Tue Mar 8 19:38:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-693581338 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 08 19:38:36.616723 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:38:36.617419 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:38:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:38:55.880805 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:38:55.881468 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:38:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:40:04.666848 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:40:04.667453 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:40:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:40:23.223343 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:40:23.224045 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:40:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:40:37.347806 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:40:37.348540 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:40:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:41:56.624950 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:41:56.625587 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:41:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:42:15.889110 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:42:15.890188 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:42:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:43:24.675105 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:43:24.675743 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:43:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:43:43.232148 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:43:43.232931 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:43:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:43:51.689862 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:43:51.690443 dv-cinder-830091-3-iscsi devstack@n-api.service[117390]: Tue Mar 8 19:43:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 08 19:43:57.355879 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 08 19:43:57.356508 dv-cinder-830091-3-iscsi devstack@n-api.service[117391]: Tue Mar 8 19:43:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!